-- Logs begin at Tue 2021-12-14 09:25:56 UTC, end at Tue 2021-12-14 10:26:33 UTC. -- Dec 14 09:59:21.843418 dv-cinder-818885-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 14 09:59:21.852698 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 14 09:59:21.854652 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Dec 14 09:59:21 2021] *** Dec 14 09:59:21.854652 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 14 09:59:21.854652 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 14 09:59:21.854652 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: nodename: dv-cinder-818885-1-iscsi Dec 14 09:59:21.854652 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: machine: x86_64 Dec 14 09:59:21.854652 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: clock source: unix Dec 14 09:59:21.854652 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: pcre jit disabled Dec 14 09:59:21.854652 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: detected number of CPU cores: 4 Dec 14 09:59:21.854652 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: current working directory: / Dec 14 09:59:21.854652 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: detected binary path: /usr/bin/uwsgi-core Dec 14 09:59:21.855345 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: your processes number limit is 47680 Dec 14 09:59:21.855345 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: your memory page size is 4096 bytes Dec 14 09:59:21.855345 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: detected max file descriptor number: 2048 Dec 14 09:59:21.855345 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: lock engine: pthread robust mutexes Dec 14 09:59:21.855345 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: thunder lock: enabled Dec 14 09:59:21.855345 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 14 09:59:21.855345 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 14 09:59:21.896339 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: Python main interpreter initialized at 0x565172aa59c0 Dec 14 09:59:21.896339 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: python threads support enabled Dec 14 09:59:21.896339 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: your server socket listen backlog is limited to 100 connections Dec 14 09:59:21.896339 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: your mercy for graceful operations on workers is 90 seconds Dec 14 09:59:21.896670 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: mapped 403077 bytes (393 KB) for 2 cores Dec 14 09:59:21.896743 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: *** Operational MODE: preforking *** Dec 14 09:59:21.896986 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: *** uWSGI is running in multiple interpreter mode *** Dec 14 09:59:21.896986 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: spawned uWSGI master process (pid: 86168) Dec 14 09:59:21.897175 dv-cinder-818885-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 14 09:59:21.900078 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: spawned uWSGI worker 1 (pid: 86169, cores: 1) Dec 14 09:59:21.900078 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: spawned uWSGI worker 2 (pid: 86170, cores: 1) Dec 14 09:59:21.900078 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 14 09:59:25.943492 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 14 09:59:25.944252 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 14 09:59:25.944252 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 14 09:59:25.944561 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 14 09:59:25.944817 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 14 09:59:25.945208 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.945536 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.945861 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.946212 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.946548 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.946863 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.947187 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.947510 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.947840 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.948105 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.948423 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.948752 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818885-1-iscsi {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.949077 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.949387 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.949700 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.950042 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.950355 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.950683 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.950991 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.951230 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 14 09:59:25.951680 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.951780 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 14 09:59:25.951943 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.952032 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 14 09:59:25.952252 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.952345 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 14 09:59:25.952546 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.952644 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 14 09:59:25.952886 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.952983 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.953204 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.953305 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.953517 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.953609 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.953841 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.953939 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.954179 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.954272 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.954510 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.954600 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.954823 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.954945 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.955145 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.955260 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818885-1-iscsi {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.955462 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.955547 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.955731 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.955831 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.956068 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.956211 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.956502 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.956815 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.956937 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818885-1-iscsi {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.957127 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.957255 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.957451 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.957587 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.957778 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.957907 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.958114 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.958248 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.958446 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.958583 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.958774 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.958890 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.959100 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.959193 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.959422 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.959606 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.959728 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.959925 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.960039 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.960238 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.960351 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.960555 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.960673 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.960897 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.960979 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.961218 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.961308 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.961515 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.961605 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.961826 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.961918 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.962177 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.962269 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.962504 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.962586 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.962816 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.962899 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.963070 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.963154 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818885-1-iscsi {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.963324 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.963446 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.963648 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.963761 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.963972 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.964070 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.964284 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.964479 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.964600 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.964796 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.964918 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.965110 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.965207 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.965434 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.965518 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.965764 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.965853 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.966100 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.966199 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.966433 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.966516 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.966753 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.966841 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.967072 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.967163 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.967394 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.967486 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.967702 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.967786 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.968017 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.968101 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.968330 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.968413 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.968657 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.968764 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.968964 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.969062 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.969273 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.969357 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.969531 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.969628 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.969845 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.969934 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.970197 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.970292 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.970523 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.970618 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.970852 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.970941 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.971110 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.971194 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.971375 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.971499 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.971731 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.971826 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.972241 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.972338 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.972712 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.972800 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.972974 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.973073 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.973288 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.973384 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.973605 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.973693 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.973933 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.974067 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.974270 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.974361 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.974586 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.974674 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.974897 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.974985 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.975205 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.975302 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.975518 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.975606 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.975831 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.975919 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.976143 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.976243 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.976451 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.976538 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.976761 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.976860 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.977069 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.977166 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.977381 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.977533 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.977675 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.977809 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.978002 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.978160 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.978328 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.978476 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.978652 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.978802 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.978960 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.979166 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.979305 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.979437 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.979620 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.979759 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.979901 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.980041 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.980180 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.980327 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.980466 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.980600 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.980756 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.980890 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.981022 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.981159 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.981331 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.981472 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.981636 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.981793 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.982008 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.982150 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.982297 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.982429 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.982578 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.982721 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.982861 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.983001 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.983169 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.983310 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.983497 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.983676 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.983816 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.983955 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.984088 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.984226 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.984370 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.984514 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.984646 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.984779 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.984953 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.985102 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.985258 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.985397 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.985565 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.985704 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.985871 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.986053 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.986193 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.986327 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.986500 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.986648 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.986822 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.987035 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.987177 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.987813 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.987964 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.988095 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.988353 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.988835 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.988985 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.989119 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.989339 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.989496 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.989640 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.989779 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.989916 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.990081 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.990263 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.990404 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.990544 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.990685 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.990818 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.990957 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.991092 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.991320 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.991510 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.991685 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.991836 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.991997 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.992203 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.992348 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.992492 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.992626 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.992758 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.992897 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.993031 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.993165 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.993316 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.993451 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.993583 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.993715 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.993848 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.994003 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.994155 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.994291 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.994478 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.994619 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.994799 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.994948 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.995126 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.995279 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.995443 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.995583 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.995764 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.995912 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.996092 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.996232 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.996406 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.996547 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.996732 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.996889 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.997025 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.997157 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.997333 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 09:59:25.997482 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.997672 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.997825 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.998033 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.998176 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.998351 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.998501 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.998680 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.998821 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.999037 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.999185 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.999338 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.999552 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.999700 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:25.999921 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.000106 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.000259 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.000402 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.000538 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.000677 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.000819 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.000953 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.001086 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.001225 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.001369 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.001511 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.001653 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.001787 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.001919 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.002091 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.002241 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.002453 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.002602 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.002737 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.002876 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.003580 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.003852 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.004109 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.004338 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.004482 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.004659 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.004810 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.005003 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.005154 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.005324 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.005473 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.005646 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.005795 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.005981 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.006128 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.006309 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.006461 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.006629 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.006771 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.006947 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.007090 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.007258 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.007400 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.007589 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.007773 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.007917 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.008052 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.008192 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.008340 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.008515 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.008657 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.008829 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.008977 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.009197 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.009337 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.009478 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.009700 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.009850 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.010010 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.010152 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.010293 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.010439 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.010588 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.010723 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.010856 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.010989 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.011139 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.011307 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.011456 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.011634 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.011779 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.011951 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.012099 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.012266 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.012428 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.012629 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.012767 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.012907 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.013041 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.013204 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.013353 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.013516 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.013656 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.013830 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.014032 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.014190 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.014337 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.014470 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.014603 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.014757 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.014898 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.015076 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.015219 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.015385 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.015533 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.015693 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.015834 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.016002 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.016143 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.016294 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.016429 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.016600 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.016742 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.016926 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.017075 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.017235 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.017381 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.017527 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.017660 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.017836 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.017999 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.018171 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.018324 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.018469 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.018624 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.018908 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.019244 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.019396 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.019562 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.019810 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.019965 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.020101 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.020234 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.020365 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.020498 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.020641 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.020791 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.020926 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.021093 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.021235 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.021411 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.021552 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.021739 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.021889 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.022074 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.022216 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.022392 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.022545 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.023041 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.023189 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.023331 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.023465 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.023599 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.023773 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.023942 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.024076 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.024222 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.024362 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.024502 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.024713 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.024867 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.025007 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.025141 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.025273 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.025406 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.025551 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.025693 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.025833 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.026020 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.026179 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.026319 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.026461 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.026595 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.026746 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.026914 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.027058 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.027205 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.027339 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.027525 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.027672 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.027831 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.027977 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.028150 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.028292 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.028463 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.028604 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.028755 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.028892 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.029062 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.029204 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.029420 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.029568 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.029703 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.029861 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.030101 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.030268 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.030474 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.030627 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.030764 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.030909 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.031056 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.031190 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.031323 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.031456 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.031595 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.031736 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.031870 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.032004 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.032143 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.032275 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.032408 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.032551 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.032707 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.032847 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.033081 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.033238 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.033373 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.033515 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.033649 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.033782 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.034003 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.034159 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.034587 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.034753 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.034897 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.035186 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.035334 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.035506 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.035656 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.035805 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.035946 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.036137 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.036295 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.036436 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.036625 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.036779 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.037060 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.037211 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.037363 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.037503 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.037651 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.037792 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.037938 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.037938 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.038236 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.038386 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.038535 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.038675 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.038815 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.039541 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.039688 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.039838 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.039979 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.040208 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.040356 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.040356 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.040631 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.040631 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.040896 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.041035 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.041181 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.041322 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.041482 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.041623 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.041623 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.041897 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.042062 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.042203 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.042354 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.042497 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.042497 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.042762 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.042762 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.043034 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.043238 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.043394 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.043536 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.043689 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.043837 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.043989 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.044130 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.044269 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.044408 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.044548 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.044548 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.044872 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.045021 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.045161 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.045311 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.045457 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.045598 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.045745 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.045885 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.046081 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.046222 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.046368 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.046511 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.046664 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.046805 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.046945 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.047162 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.047325 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.047467 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.047615 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.047757 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.047905 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.048045 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.048184 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.048331 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.048472 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.048611 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.048758 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.048898 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.049043 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.049202 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.049350 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.049491 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.049491 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.049754 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.050491 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.050650 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.050792 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.050933 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.051078 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.051251 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.051401 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.051584 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.051733 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.051931 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.052080 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.052243 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.052399 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.052541 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.052681 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.052866 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.053015 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.053176 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.053332 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.053480 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.053631 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.053771 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.053910 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.054110 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.054340 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.054484 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.054624 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.054763 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.054908 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.055055 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.055203 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.055343 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.055483 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.055638 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.055785 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.055934 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.056083 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.056224 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.056373 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.056513 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.056660 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.056808 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.056948 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.057094 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.057332 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.057486 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.057637 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.057783 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.057924 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.058132 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.058276 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.058415 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.058561 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.058701 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.058848 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.058994 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.059134 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.059280 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.059421 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.059573 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.059722 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.059862 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.060008 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.060149 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.060289 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.060427 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.060657 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.060806 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.060953 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.061094 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.061233 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.061384 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.061535 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.061676 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.061814 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.061968 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.062133 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.062285 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.062428 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.062566 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.062705 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.062843 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.062981 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.063128 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.063303 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.063452 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.063614 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.063767 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.063914 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.064063 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.064244 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.064391 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.064558 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.064705 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.064867 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.065022 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.065163 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.065319 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.066085 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.066255 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.066439 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.066893 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.067050 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.067204 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.067362 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.067572 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.067719 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.067866 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.068016 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.068157 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.068308 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.068448 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.068594 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.068736 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.068919 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.069065 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.069205 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.069352 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.069492 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.069643 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.069784 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.069973 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.070136 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.070289 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.070428 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.070579 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.070808 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.070957 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.071097 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.071237 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.071377 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.071526 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.071668 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.071809 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.071949 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.072089 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.072243 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.072392 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.072533 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.072679 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.072826 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.072969 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.073108 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.073290 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.073439 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.073601 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.073755 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.073898 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.074118 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.074281 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.074423 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.074563 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.074702 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.074848 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.074997 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.075138 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.075278 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.075417 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.075564 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.075711 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.075860 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.076008 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.076166 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.076319 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.076465 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.076637 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.076798 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.076940 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.077080 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.077290 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.077438 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.077608 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.077816 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.077995 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.078164 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.078306 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.078453 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.078667 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.078810 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.078949 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.079095 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.079243 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.079390 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.079537 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.079678 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.079817 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.079957 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.080106 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.080245 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.080393 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.080534 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.080673 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.080828 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.081061 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.081213 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.081493 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.081753 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.081906 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.082117 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.082266 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.082434 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.082577 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.082757 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.082905 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.083089 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.083236 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.083427 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.083583 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.083731 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.083871 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.084037 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.084185 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.084355 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.084514 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.084662 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.084803 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.084969 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.085117 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.085269 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.085411 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.085584 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.085738 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.085901 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.086084 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.086241 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.086352 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.086557 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.086658 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.086867 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.086966 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.087176 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.087261 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.087490 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.087604 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.087805 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.087928 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.088112 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.088252 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.088427 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.088650 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.088785 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.088971 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.089105 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.089289 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.089417 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.089619 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.089748 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.089934 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.090121 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.090262 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.090411 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.090569 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.090719 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.090886 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.091059 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.091269 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.091415 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.091554 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.091703 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.091846 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.091985 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.092124 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.092263 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.092438 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.092605 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.092753 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.092894 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.093064 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.093222 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.093397 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.093554 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.093717 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.093872 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.094070 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.094221 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.094423 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.094570 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.094721 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.094862 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.095027 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.095173 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.095343 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.095498 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.095672 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.095818 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.095982 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.096129 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.096277 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.096418 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.096586 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.096772 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.096969 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.097281 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.097436 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.097613 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.097761 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.097918 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.098117 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.098258 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.098410 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.098552 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.098701 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.098852 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.098999 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.099147 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.099408 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.099558 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.099727 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.099873 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.100037 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.100189 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.100362 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.100510 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.100678 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.100824 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.101007 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.101163 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.101386 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.101541 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.101682 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.101820 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.101989 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.102171 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.102315 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.102453 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.102592 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.102737 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.102885 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.103049 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.103197 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.103338 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.103477 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.103617 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.103765 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.103906 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.104097 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.104246 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.104430 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.104583 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.104759 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.104907 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.105058 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.105198 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.105397 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.105552 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.105727 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.105875 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.106064 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.106236 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.106378 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.106531 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.106704 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.106851 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.107013 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.107171 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.107312 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.107462 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.107625 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.107810 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.107954 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.108095 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.108261 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.108476 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.108619 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.108759 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.108906 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.109064 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.109205 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.109361 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.109502 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.109642 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.109790 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.109929 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.110096 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.110268 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.110410 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.110557 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.110698 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.110838 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.110999 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.111146 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.111287 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.111508 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.111656 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.111803 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.111952 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.112092 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.112240 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.112902 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.113044 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.113315 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.113643 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.113990 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.114165 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.114332 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.114488 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.114636 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.114778 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.114963 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.115120 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.115287 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.115434 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.115606 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.115755 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.115926 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.116097 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.116239 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.116379 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.116554 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.116703 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.116878 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.117038 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.117186 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.117326 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.117498 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.117645 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.117819 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.117993 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.118151 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.118292 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.118475 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.118624 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.118893 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.119040 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.119188 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.119330 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.119500 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.119648 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.119864 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.120017 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.120169 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.120309 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.120448 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.120587 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.120735 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.120875 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.121015 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.121154 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.121295 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.121443 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.121670 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.121817 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.122016 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.122176 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.122318 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.122469 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.122611 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.122751 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.122898 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.123039 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.123180 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.123328 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.123470 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.123654 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.123809 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.123977 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.124144 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.124295 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.124438 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.124610 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.124758 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.124978 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.125139 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.125303 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.125458 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.125600 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.125740 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.125925 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.126158 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.126312 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.126463 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.126610 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.126757 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.126906 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.127054 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.127194 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.127334 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.127502 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.127658 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.127806 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.128019 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.128735 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.129062 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.129378 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.129658 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.129817 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.130033 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.130195 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.130373 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.130530 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.130701 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.130856 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.131022 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.131181 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.131344 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.131498 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.131667 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.131882 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.132175 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.132333 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.132496 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.132645 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.132822 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.132970 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.133146 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.133294 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.133468 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.133616 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.133789 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.133944 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.134133 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.134273 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.134439 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.134594 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.134746 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.134886 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.135051 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.135199 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.135370 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.135527 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.135669 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.135818 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.135982 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.136131 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.136310 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.136467 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.136644 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.136791 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.136932 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.137079 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.137220 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.137379 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.137530 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.137669 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.137898 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.138090 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.138290 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.138443 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.138618 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.138765 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.138933 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.139088 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.139241 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.139402 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.139570 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.139718 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.139893 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.140066 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.140219 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.140360 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.140506 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.140647 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.140826 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.140981 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.141151 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.141309 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.141474 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.141620 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.141767 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.142024 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.142177 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.142318 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.142465 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.142606 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.142746 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.142894 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.143034 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.143175 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.143326 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.143467 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.143631 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.143831 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.143987 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.144308 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.144601 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.144749 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.144919 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.145066 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.145238 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.145453 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.145601 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.145780 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.145941 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.146144 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.146287 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.146460 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.146607 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.146780 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.146944 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.147087 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.147227 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.147374 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.147515 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.147939 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.148100 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.148243 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.148384 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.148555 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.148710 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.148851 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.148999 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.149163 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.149311 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.149482 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.149629 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.149779 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.149928 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.150109 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.150252 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.150399 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.150541 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.150757 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.150899 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.151039 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.151179 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.151324 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.151571 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.151729 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.151924 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.152161 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.152316 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.152456 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.152603 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.152790 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.152941 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.153137 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.153285 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.153465 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.153624 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.153799 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.153946 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.154130 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.154295 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.154438 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.154591 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.154734 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.154874 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.155041 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.155189 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.155351 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.155508 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.155651 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.155798 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.155949 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.156090 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.156243 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.156392 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.156534 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.156681 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.156851 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.157000 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.157149 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.157291 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.157475 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.157695 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.157851 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.158028 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.158198 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.158340 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.158488 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.158629 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.158769 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.158955 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.159113 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.159361 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.159690 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.159844 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.160014 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.160170 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.160323 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.160476 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.160646 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.160794 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.160963 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.161119 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.161268 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.161407 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.161575 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.161723 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.161888 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.162094 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.162319 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.162464 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.162615 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.162755 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.162903 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.163054 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.163201 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.163348 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.163488 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.163627 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.163767 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.163915 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.164055 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.164196 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.164346 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.164485 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.164633 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.164780 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.164935 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.165134 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.165283 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.165477 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.165639 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.165814 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.165997 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.166155 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.166442 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.166606 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.166758 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.166898 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.167073 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.167221 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.167389 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.167536 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.167736 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.167933 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.168079 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.168250 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.168398 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.168546 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.168696 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.168859 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.169006 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.169185 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.169341 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.169490 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.169630 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.169804 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.169973 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.170149 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.170307 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.170461 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.170602 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.170753 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.170894 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.171071 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.171218 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.171463 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.171615 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.171769 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.171912 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.172052 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.172200 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.172433 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.172584 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.172742 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.172884 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.173024 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.173176 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.173317 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.173457 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.173598 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.173738 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.173877 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.174089 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.174235 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.174375 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.174521 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.174673 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.175349 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.175570 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.175718 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.176068 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.176216 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.176394 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.176543 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.176721 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.176870 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.177060 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.177206 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.177382 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.177548 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.177690 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.177831 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.178045 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.178195 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.178363 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.178523 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.178672 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.178825 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.178988 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.179137 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.179305 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.179477 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.179625 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.179767 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.179929 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.180077 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.180264 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.180413 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.180596 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.180743 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.180907 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.181054 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.181253 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.181404 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.181555 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.181695 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.181835 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.182016 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.182178 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.182319 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.182542 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.182691 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.182831 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.182985 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.183132 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.183284 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.183442 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.183590 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.183730 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.183883 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.184025 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.184166 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.184305 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.184445 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.184624 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.184785 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.184955 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.185111 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.185285 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.185450 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.185592 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.185739 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.185916 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.186105 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.186254 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.186395 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.186569 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.186730 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.186872 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.187012 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.187192 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.187349 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.187509 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=86170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 14 09:59:26.187651 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.187791 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.188104 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.188423 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.188760 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.189078 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.189406 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.189721 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.190075 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.190391 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.191793 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.192129 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.192456 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.192778 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.193116 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.193435 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.193798 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.194097 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.194418 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.194738 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.195055 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.195395 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.195728 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.196041 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.196372 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.196697 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.197023 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.197344 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.197662 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.198021 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.198340 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.198662 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.198977 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.199293 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.199612 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.199933 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.200265 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.200593 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.200925 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.201257 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.201610 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.201927 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.202301 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.202632 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 09:59:26.202868 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=86169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 14 09:59:26.220097 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG oslo_db.sqlalchemy.engines [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 14 09:59:26.234389 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_db.sqlalchemy.engines [None req-17264b63-14a0-4afe-84e2-1b8ae52c0e3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 14 09:59:26.465378 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.context [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),26d0cb61-6736-4223-b055-fa824f7338a4(cell1) {{(pid=86170) load_cells /opt/stack/nova/nova/context.py:464}} Dec 14 09:59:26.469511 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG oslo_concurrency.lockutils [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 09:59:26.471188 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG oslo_concurrency.lockutils [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=86170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 09:59:26.472028 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG oslo_concurrency.lockutils [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 09:59:26.474019 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG oslo_concurrency.lockutils [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=86170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 09:59:26.486184 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.context [None req-17264b63-14a0-4afe-84e2-1b8ae52c0e3e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),26d0cb61-6736-4223-b055-fa824f7338a4(cell1) {{(pid=86169) load_cells /opt/stack/nova/nova/context.py:464}} Dec 14 09:59:26.491064 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-17264b63-14a0-4afe-84e2-1b8ae52c0e3e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 09:59:26.492722 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-17264b63-14a0-4afe-84e2-1b8ae52c0e3e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 09:59:26.493530 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-17264b63-14a0-4afe-84e2-1b8ae52c0e3e None None] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 09:59:26.495550 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-17264b63-14a0-4afe-84e2-1b8ae52c0e3e None None] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 09:59:26.498905 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG oslo_db.sqlalchemy.engines [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 14 09:59:26.499723 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG oslo_db.sqlalchemy.engines [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 14 09:59:26.526575 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_db.sqlalchemy.engines [None req-17264b63-14a0-4afe-84e2-1b8ae52c0e3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 14 09:59:26.527373 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_db.sqlalchemy.engines [None req-17264b63-14a0-4afe-84e2-1b8ae52c0e3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 14 09:59:26.532419 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG oslo_db.sqlalchemy.engines [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 14 09:59:26.558196 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_db.sqlalchemy.engines [None req-17264b63-14a0-4afe-84e2-1b8ae52c0e3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 14 09:59:26.696327 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO keyring.backend [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] Loading KWallet Dec 14 09:59:26.705995 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO keyring.backend [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] Loading SecretService Dec 14 09:59:26.709481 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 09:59:26.709481 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: from cryptography.utils import int_from_bytes Dec 14 09:59:26.709795 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 09:59:26.709795 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: from cryptography.utils import int_from_bytes Dec 14 09:59:26.710525 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO keyring.backend [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] Loading Windows Dec 14 09:59:26.712328 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO keyring.backend [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] Loading chainer Dec 14 09:59:26.713101 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO keyring.backend [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] Loading macOS Dec 14 09:59:26.715557 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO keyring.backend [None req-17264b63-14a0-4afe-84e2-1b8ae52c0e3e None None] Loading KWallet Dec 14 09:59:26.725877 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO keyring.backend [None req-17264b63-14a0-4afe-84e2-1b8ae52c0e3e None None] Loading SecretService Dec 14 09:59:26.735138 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 09:59:26.735138 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: from cryptography.utils import int_from_bytes Dec 14 09:59:26.736124 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 09:59:26.736124 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: from cryptography.utils import int_from_bytes Dec 14 09:59:26.737063 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO keyring.backend [None req-17264b63-14a0-4afe-84e2-1b8ae52c0e3e None None] Loading Windows Dec 14 09:59:26.739638 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO keyring.backend [None req-17264b63-14a0-4afe-84e2-1b8ae52c0e3e None None] Loading chainer Dec 14 09:59:26.740422 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO keyring.backend [None req-17264b63-14a0-4afe-84e2-1b8ae52c0e3e None None] Loading macOS Dec 14 09:59:27.064536 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: WARNING keystonemiddleware.auth_token [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 09:59:27.071623 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: WARNING keystonemiddleware.auth_token [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 09:59:27.095621 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: WARNING keystonemiddleware.auth_token [None req-17264b63-14a0-4afe-84e2-1b8ae52c0e3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 09:59:27.102266 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: WARNING keystonemiddleware.auth_token [None req-17264b63-14a0-4afe-84e2-1b8ae52c0e3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 09:59:27.282532 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: WARNING keystonemiddleware.auth_token [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 09:59:27.287876 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: WARNING keystonemiddleware.auth_token [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 09:59:27.293201 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x565172aa59c0 pid: 86170 (default app) Dec 14 09:59:27.295238 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 09:59:27.296345 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001657 Dec 14 09:59:27.296751 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Tue Dec 14 09:59:27 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 09:59:27.312939 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: WARNING keystonemiddleware.auth_token [None req-17264b63-14a0-4afe-84e2-1b8ae52c0e3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 09:59:27.318692 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: WARNING keystonemiddleware.auth_token [None req-17264b63-14a0-4afe-84e2-1b8ae52c0e3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 09:59:27.323904 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x565172aa59c0 pid: 86169 (default app) Dec 14 10:00:46.876130 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:00:46.877233 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001914 Dec 14 10:00:46.877616 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 930 bytes} [Tue Dec 14 10:00:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:00:47.433209 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-fee0012b-aa8f-478c-900a-01de729f78c5 admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:00:47.458827 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-fee0012b-aa8f-478c-900a-01de729f78c5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.574358 Dec 14 10:00:47.459387 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Dec 14 10:00:46 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:00:49.581182 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:00:49.582277 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-ea7b80e6-3ac0-45f5-9ead-bc94390256f4 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001813 Dec 14 10:00:49.582645 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 930 bytes} [Tue Dec 14 10:00:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:00:49.638167 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-f2f09734-18bd-4a77-945d-3c2112508c8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "name": "cirros256"}} {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:00:49.655677 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:00:49.655677 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: warnings.warn(msg) Dec 14 10:00:49.681688 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-f2f09734-18bd-4a77-945d-3c2112508c8d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.093217 Dec 14 10:00:49.682247 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Dec 14 10:00:49 2021] POST /compute/v2.1/flavors => generated 407 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:00:49.895651 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-f38f89d1-b703-4f62-84e4-229c575718b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:00:49.897829 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:00:49.897829 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: warnings.warn(msg) Dec 14 10:00:50.052307 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-f38f89d1-b703-4f62-84e4-229c575718b5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.362050 Dec 14 10:00:50.052898 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Dec 14 10:00:49 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:00:52.194423 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-f2f09734-18bd-4a77-945d-3c2112508c8d admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:00:52.195406 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-f2f09734-18bd-4a77-945d-3c2112508c8d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Dec 14 10:00:52.195789 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 930 bytes} [Tue Dec 14 10:00:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:00:52.299730 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-bf30b027-b5f8-4da1-8790-420af4fd2a67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "disk": 5, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:00:52.316837 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:00:52.316837 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: warnings.warn(msg) Dec 14 10:00:52.340292 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-bf30b027-b5f8-4da1-8790-420af4fd2a67 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138810 Dec 14 10:00:52.340887 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Dec 14 10:00:52 2021] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:00:52.352809 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-08264fcc-5314-4393-9d50-d776fa5714a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:00:52.354415 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:00:52.354415 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: warnings.warn(msg) Dec 14 10:00:52.388837 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-08264fcc-5314-4393-9d50-d776fa5714a4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039625 Dec 14 10:00:52.389566 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Dec 14 10:00:52 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:00:54.577329 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-bf30b027-b5f8-4da1-8790-420af4fd2a67 admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:00:54.578352 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-bf30b027-b5f8-4da1-8790-420af4fd2a67 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Dec 14 10:00:54.578863 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 930 bytes} [Tue Dec 14 10:00:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:00:54.633350 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-0bf75353-4aac-44a2-876c-4f6c7ba130fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d2", "swap": 0}} {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:00:54.656606 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-0bf75353-4aac-44a2-876c-4f6c7ba130fe admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072015 Dec 14 10:00:54.657160 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Dec 14 10:00:54 2021] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:00:54.668605 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-8e463ad5-304c-4eb3-af4e-2476c16894e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:00:54.702966 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-8e463ad5-304c-4eb3-af4e-2476c16894e9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037952 Dec 14 10:00:54.703545 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Dec 14 10:00:54 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:00:56.843534 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-0bf75353-4aac-44a2-876c-4f6c7ba130fe admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:00:56.844655 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-0bf75353-4aac-44a2-876c-4f6c7ba130fe admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Dec 14 10:00:56.845053 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 930 bytes} [Tue Dec 14 10:00:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:00:56.899866 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-a80ea8fc-820f-4ce4-a4ee-444d70ca51fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3"}} {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:00:56.924387 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-a80ea8fc-820f-4ce4-a4ee-444d70ca51fd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073542 Dec 14 10:00:56.924932 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Dec 14 10:00:56 2021] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:00:56.937281 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-434c6985-51dc-4107-a128-1a7e4640a57b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:00:56.971454 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-434c6985-51dc-4107-a128-1a7e4640a57b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038363 Dec 14 10:00:56.972010 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Dec 14 10:00:56 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:00:59.106976 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-a80ea8fc-820f-4ce4-a4ee-444d70ca51fd admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:00:59.108011 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-a80ea8fc-820f-4ce4-a4ee-444d70ca51fd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002617 Dec 14 10:00:59.108411 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 930 bytes} [Tue Dec 14 10:00:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:00:59.181196 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-5822133f-1efd-4e24-9614-fef28fbc4536 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "disk": 20}} {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:00:59.205561 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-5822133f-1efd-4e24-9614-fef28fbc4536 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.088295 Dec 14 10:00:59.206132 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Dec 14 10:00:59 2021] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:00:59.218900 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-7a4d8465-71d5-4a75-946a-2a5941effa1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:00:59.260575 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-7a4d8465-71d5-4a75-946a-2a5941effa1f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045165 Dec 14 10:00:59.261478 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Dec 14 10:00:59 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:01:01.393960 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-5822133f-1efd-4e24-9614-fef28fbc4536 admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:01:01.394958 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-5822133f-1efd-4e24-9614-fef28fbc4536 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Dec 14 10:01:01.395349 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 930 bytes} [Tue Dec 14 10:01:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:01:01.450492 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-11985a3b-008a-4438-b1f0-e1e668cfc1a4 admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:01:01.474752 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-11985a3b-008a-4438-b1f0-e1e668cfc1a4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.073418 Dec 14 10:01:01.475275 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Dec 14 10:01:01 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:01:03.604254 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-5822133f-1efd-4e24-9614-fef28fbc4536 admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:01:03.605244 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-5822133f-1efd-4e24-9614-fef28fbc4536 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Dec 14 10:01:03.605638 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 930 bytes} [Tue Dec 14 10:01:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:01:03.661887 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-20acb4f6-73ef-4c03-aba0-9b780fdd7371 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "1", "disk": 1, "name": "m1.tiny"}} {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:01:03.685258 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-20acb4f6-73ef-4c03-aba0-9b780fdd7371 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073513 Dec 14 10:01:03.685794 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Dec 14 10:01:03 2021] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:01:03.697546 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-5ba2c27f-1364-4d65-954a-21adcefba108 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:01:03.732496 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-5ba2c27f-1364-4d65-954a-21adcefba108 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038654 Dec 14 10:01:03.733050 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Dec 14 10:01:03 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:01:05.843911 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-20acb4f6-73ef-4c03-aba0-9b780fdd7371 admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:01:05.844829 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-20acb4f6-73ef-4c03-aba0-9b780fdd7371 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Dec 14 10:01:05.845217 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 930 bytes} [Tue Dec 14 10:01:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:01:05.899978 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-62cac00b-018e-49ed-b84b-7ca7164b585d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "ram": 2048}} {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:01:05.924566 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-62cac00b-018e-49ed-b84b-7ca7164b585d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073688 Dec 14 10:01:05.925095 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Dec 14 10:01:05 2021] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:01:05.936658 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-3e750db1-a9cc-448c-9d30-b73f3756b7ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:01:05.971402 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-3e750db1-a9cc-448c-9d30-b73f3756b7ae admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038380 Dec 14 10:01:05.971936 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Dec 14 10:01:05 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:01:08.100428 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-62cac00b-018e-49ed-b84b-7ca7164b585d admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:01:08.101425 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-62cac00b-018e-49ed-b84b-7ca7164b585d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Dec 14 10:01:08.101809 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 930 bytes} [Tue Dec 14 10:01:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:01:08.156990 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-12291d5c-2b1d-42e5-92b4-127d76de1155 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "disk": 40, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:01:08.180782 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-12291d5c-2b1d-42e5-92b4-127d76de1155 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072999 Dec 14 10:01:08.181313 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Dec 14 10:01:08 2021] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:01:08.193002 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-6cf66270-e9c4-41d1-9e8d-959a9e6a43d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:01:08.228891 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-6cf66270-e9c4-41d1-9e8d-959a9e6a43d6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039835 Dec 14 10:01:08.229434 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Dec 14 10:01:08 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:01:10.367320 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-12291d5c-2b1d-42e5-92b4-127d76de1155 admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:01:10.368352 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-12291d5c-2b1d-42e5-92b4-127d76de1155 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Dec 14 10:01:10.368749 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 930 bytes} [Tue Dec 14 10:01:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:01:10.424367 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-ed4f7c94-15a5-4335-a96c-74213061ee08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "disk": 80, "name": "m1.large", "swap": 0, "id": "4"}} {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:01:10.447958 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-ed4f7c94-15a5-4335-a96c-74213061ee08 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073353 Dec 14 10:01:10.448486 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Dec 14 10:01:10 2021] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:01:10.460584 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-f7b6bf54-12a1-47a4-81a6-b13fc1eae60f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:01:10.494370 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-f7b6bf54-12a1-47a4-81a6-b13fc1eae60f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037459 Dec 14 10:01:10.494928 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Dec 14 10:01:10 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:01:12.605923 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-ed4f7c94-15a5-4335-a96c-74213061ee08 admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:01:12.606934 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-ed4f7c94-15a5-4335-a96c-74213061ee08 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Dec 14 10:01:12.607315 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 930 bytes} [Tue Dec 14 10:01:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:01:12.661770 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-c07cbf57-92e0-4632-bb1c-230e64427889 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 160, "swap": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384, "vcpus": 8}} {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:01:12.686092 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-c07cbf57-92e0-4632-bb1c-230e64427889 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.072458 Dec 14 10:01:12.686630 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Dec 14 10:01:12 2021] POST /compute/v2.1/flavors => generated 408 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:01:12.698164 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-d5b1ca8f-4d3e-456b-a9fb-43e107c59af8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:01:12.732329 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-d5b1ca8f-4d3e-456b-a9fb-43e107c59af8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037767 Dec 14 10:01:12.732877 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Dec 14 10:01:12 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:02:18.934074 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-c07cbf57-92e0-4632-bb1c-230e64427889 admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:18.935070 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-c07cbf57-92e0-4632-bb1c-230e64427889 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Dec 14 10:02:18.935475 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 930 bytes} [Tue Dec 14 10:02:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:02:18.995732 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-84d3753d-3271-4277-88f5-72568bdcdb75 admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:19.032052 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-84d3753d-3271-4277-88f5-72568bdcdb75 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.088508 Dec 14 10:02:19.032593 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Dec 14 10:02:18 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:02:20.474083 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-c07cbf57-92e0-4632-bb1c-230e64427889 admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:20.475053 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-c07cbf57-92e0-4632-bb1c-230e64427889 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Dec 14 10:02:20.475443 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Dec 14 10:02:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:02:20.662092 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-1dc87d85-7b9a-4823-b05d-ba0172fe03c8 admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:20.674638 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.wsgi [None req-1dc87d85-7b9a-4823-b05d-ba0172fe03c8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 14 10:02:20.675778 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-1dc87d85-7b9a-4823-b05d-ba0172fe03c8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=86169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:02:20.676566 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-1dc87d85-7b9a-4823-b05d-ba0172fe03c8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.064642 Dec 14 10:02:20.677081 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Dec 14 10:02:20 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 14 10:02:20.686417 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-1cb4b740-dbec-4a03-aee4-59ec1adc08c4 admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:20.706143 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-1cb4b740-dbec-4a03-aee4-59ec1adc08c4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023226 Dec 14 10:02:20.707373 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Dec 14 10:02:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:02:20.716998 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-c526860c-e048-4e88-84a2-b230af3cd0c7 admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:20.736434 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-c526860c-e048-4e88-84a2-b230af3cd0c7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.022919 Dec 14 10:02:20.736947 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Dec 14 10:02:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:02:20.745906 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-c2aee374-2ae7-43df-ab9e-af8da7da06ad admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:20.758406 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.wsgi [None req-c2aee374-2ae7-43df-ab9e-af8da7da06ad admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 14 10:02:20.758973 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-c2aee374-2ae7-43df-ab9e-af8da7da06ad admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=86170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:02:20.759742 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-c2aee374-2ae7-43df-ab9e-af8da7da06ad admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.017237 Dec 14 10:02:20.760229 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Dec 14 10:02:20 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 14 10:02:22.093930 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-c526860c-e048-4e88-84a2-b230af3cd0c7 admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:22.094938 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-c526860c-e048-4e88-84a2-b230af3cd0c7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Dec 14 10:02:22.095327 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Dec 14 10:02:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:02:22.285811 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-a5630884-66b0-48b1-b69d-fe1e45efeff6 admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:22.297436 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.wsgi [None req-a5630884-66b0-48b1-b69d-fe1e45efeff6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 14 10:02:22.298015 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-a5630884-66b0-48b1-b69d-fe1e45efeff6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=86170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:02:22.298784 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-a5630884-66b0-48b1-b69d-fe1e45efeff6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.062989 Dec 14 10:02:22.299272 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Dec 14 10:02:22 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 14 10:02:22.308763 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-2c3bb8c0-e8a2-415d-b44b-26ed036c6922 admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:22.328367 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-2c3bb8c0-e8a2-415d-b44b-26ed036c6922 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023252 Dec 14 10:02:22.328908 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Dec 14 10:02:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:02:22.338652 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-397718c7-cada-4d17-9288-9b9614dcb45a admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:22.358012 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-397718c7-cada-4d17-9288-9b9614dcb45a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.022726 Dec 14 10:02:22.358546 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Dec 14 10:02:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:02:22.367834 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-24fbc88e-9e60-403e-b7c0-f7e4978b5bee admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:22.380292 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.wsgi [None req-24fbc88e-9e60-403e-b7c0-f7e4978b5bee admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 14 10:02:22.380855 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-24fbc88e-9e60-403e-b7c0-f7e4978b5bee admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=86169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:02:22.381629 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-24fbc88e-9e60-403e-b7c0-f7e4978b5bee admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.017327 Dec 14 10:02:22.382161 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Dec 14 10:02:22 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 14 10:02:23.699855 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-397718c7-cada-4d17-9288-9b9614dcb45a admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:23.700844 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-397718c7-cada-4d17-9288-9b9614dcb45a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Dec 14 10:02:23.701237 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Dec 14 10:02:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:02:23.888722 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-9ce4f242-1264-4ee7-98ac-e49b94b007b5 admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:23.901757 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.wsgi [None req-9ce4f242-1264-4ee7-98ac-e49b94b007b5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 14 10:02:23.902360 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-9ce4f242-1264-4ee7-98ac-e49b94b007b5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=86169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:02:23.903132 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-9ce4f242-1264-4ee7-98ac-e49b94b007b5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.063659 Dec 14 10:02:23.903636 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Dec 14 10:02:23 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 14 10:02:23.913299 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-ddff3de6-9cb8-446a-8059-bc2b56a7a4e5 admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:23.933388 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-ddff3de6-9cb8-446a-8059-bc2b56a7a4e5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023821 Dec 14 10:02:23.933906 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Dec 14 10:02:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:02:23.943874 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-34b58a20-f29a-4480-afc4-31cd6821e216 admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:23.962869 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-34b58a20-f29a-4480-afc4-31cd6821e216 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023128 Dec 14 10:02:23.963375 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Dec 14 10:02:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:02:23.972635 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-812b2f10-65ac-4e63-9022-4fba81b63578 admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:23.984343 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.wsgi [None req-812b2f10-65ac-4e63-9022-4fba81b63578 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 14 10:02:23.984907 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-812b2f10-65ac-4e63-9022-4fba81b63578 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=86170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:02:23.985682 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-812b2f10-65ac-4e63-9022-4fba81b63578 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.016593 Dec 14 10:02:23.986210 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Dec 14 10:02:23 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 14 10:02:25.340848 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-34b58a20-f29a-4480-afc4-31cd6821e216 admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:25.341852 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-34b58a20-f29a-4480-afc4-31cd6821e216 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Dec 14 10:02:25.342267 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Dec 14 10:02:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:02:25.530346 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-b2f258cd-2eea-42d1-9047-0ca992455928 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:02:25.556313 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-b2f258cd-2eea-42d1-9047-0ca992455928 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.075946 Dec 14 10:02:25.556767 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Dec 14 10:02:25 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:02:26.864998 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-34b58a20-f29a-4480-afc4-31cd6821e216 admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:26.866006 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-34b58a20-f29a-4480-afc4-31cd6821e216 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001396 Dec 14 10:02:26.866396 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Dec 14 10:02:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:02:27.057661 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-a5e27b13-e0e7-47d5-a0f0-bff5dc1d130c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:02:27.080022 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-a5e27b13-e0e7-47d5-a0f0-bff5dc1d130c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.074325 Dec 14 10:02:27.080482 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Dec 14 10:02:27 2021] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:02:28.404932 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-34b58a20-f29a-4480-afc4-31cd6821e216 admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:28.405918 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-34b58a20-f29a-4480-afc4-31cd6821e216 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Dec 14 10:02:28.406340 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Dec 14 10:02:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:02:28.591789 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-b99d13e8-e9bd-4414-ba0f-e00eb632b104 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:02:28.616251 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-b99d13e8-e9bd-4414-ba0f-e00eb632b104 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.072789 Dec 14 10:02:28.616719 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Dec 14 10:02:28 2021] POST /compute/v2.1/flavors => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:02:29.927677 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-34b58a20-f29a-4480-afc4-31cd6821e216 admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:29.928721 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-34b58a20-f29a-4480-afc4-31cd6821e216 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Dec 14 10:02:29.929110 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Dec 14 10:02:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:02:30.115175 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-448b521d-f944-4dc1-bb9a-5913c6a0d44e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:02:30.138557 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-448b521d-f944-4dc1-bb9a-5913c6a0d44e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.073862 Dec 14 10:02:30.139021 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Dec 14 10:02:30 2021] POST /compute/v2.1/flavors => generated 409 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:02:31.453499 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-34b58a20-f29a-4480-afc4-31cd6821e216 admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:31.454499 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-34b58a20-f29a-4480-afc4-31cd6821e216 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Dec 14 10:02:31.454894 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Dec 14 10:02:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:02:31.643290 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-9cc74ae0-cba9-4c67-85e7-9d9524c8b88e admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:02:31.668528 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-9cc74ae0-cba9-4c67-85e7-9d9524c8b88e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.075376 Dec 14 10:02:31.669007 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Tue Dec 14 10:02:31 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:03:15.430398 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-34b58a20-f29a-4480-afc4-31cd6821e216 admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:03:15.431385 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-34b58a20-f29a-4480-afc4-31cd6821e216 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001665 Dec 14 10:03:15.431779 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 31/63] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Dec 14 10:03:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:03:15.622700 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-59d041db-f487-4468-94bd-abd7f29796bd admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:03:15.648076 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-59d041db-f487-4468-94bd-abd7f29796bd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.074227 Dec 14 10:03:15.648359 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1202 bytes} [Tue Dec 14 10:03:15 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:04:41.172253 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-e1f4777d-2aea-48aa-8147-b65e73424937 tempest-verify_tempest_config-406017703 tempest-verify_tempest_config-406017703-project] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:04:41.174195 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-e1f4777d-2aea-48aa-8147-b65e73424937 tempest-verify_tempest_config-406017703 tempest-verify_tempest_config-406017703-project] 10.222.0.20 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.112000 Dec 14 10:04:41.174715 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 32/65] 10.222.0.20 () {58 vars in 1133 bytes} [Tue Dec 14 10:04:41 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:06:08.171199 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-59d041db-f487-4468-94bd-abd7f29796bd admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:06:08.172150 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-59d041db-f487-4468-94bd-abd7f29796bd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Dec 14 10:06:08.172541 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 34/66] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Dec 14 10:06:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:06:08.430552 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-4ebdcf19-e0fd-41ae-8aa3-9ddaf1030137 admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:06:08.431734 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:06:08.431734 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: warnings.warn(msg) Dec 14 10:06:08.433262 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-4ebdcf19-e0fd-41ae-8aa3-9ddaf1030137 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:06:08.433709 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-4ebdcf19-e0fd-41ae-8aa3-9ddaf1030137 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:06:08.434558 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-4ebdcf19-e0fd-41ae-8aa3-9ddaf1030137 admin admin] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:06:08.434979 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-4ebdcf19-e0fd-41ae-8aa3-9ddaf1030137 admin admin] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:06:08.465437 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-4ebdcf19-e0fd-41ae-8aa3-9ddaf1030137 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.153265 Dec 14 10:06:08.466010 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Dec 14 10:06:08 2021] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:06:09.805071 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-59d041db-f487-4468-94bd-abd7f29796bd admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:06:09.806115 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-59d041db-f487-4468-94bd-abd7f29796bd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Dec 14 10:06:09.806545 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 35/68] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Dec 14 10:06:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:06:09.999997 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-a2860e5d-9f45-416a-8a6b-9c2aa92c1eaf admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:06:10.001175 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:06:10.001175 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: warnings.warn(msg) Dec 14 10:06:10.003047 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-a2860e5d-9f45-416a-8a6b-9c2aa92c1eaf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:06:10.003490 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-a2860e5d-9f45-416a-8a6b-9c2aa92c1eaf admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:06:10.004281 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-a2860e5d-9f45-416a-8a6b-9c2aa92c1eaf admin admin] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:06:10.004706 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-a2860e5d-9f45-416a-8a6b-9c2aa92c1eaf admin admin] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:06:10.030418 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-a2860e5d-9f45-416a-8a6b-9c2aa92c1eaf admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.081646 Dec 14 10:06:10.031056 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 34/69] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Dec 14 10:06:09 2021] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:06:21.805787 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-59d041db-f487-4468-94bd-abd7f29796bd admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:06:21.806791 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-59d041db-f487-4468-94bd-abd7f29796bd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Dec 14 10:06:21.807184 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 36/70] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Dec 14 10:06:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:06:21.991417 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-810458ae-2c67-4271-9e9b-69d52cbda48e admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:06:21.992501 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:06:21.992501 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: warnings.warn(msg) Dec 14 10:06:21.994040 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-810458ae-2c67-4271-9e9b-69d52cbda48e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:06:21.994478 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-810458ae-2c67-4271-9e9b-69d52cbda48e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:06:21.995256 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-810458ae-2c67-4271-9e9b-69d52cbda48e admin admin] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:06:21.995698 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-810458ae-2c67-4271-9e9b-69d52cbda48e admin admin] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:06:22.023825 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-810458ae-2c67-4271-9e9b-69d52cbda48e admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.081358 Dec 14 10:06:22.024374 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 35/71] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Dec 14 10:06:21 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:06:23.383150 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: DEBUG nova.api.openstack.wsgi [None req-59d041db-f487-4468-94bd-abd7f29796bd admin admin] Calling method '>' {{(pid=86170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:06:23.384126 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: INFO nova.api.openstack.requestlog [None req-59d041db-f487-4468-94bd-abd7f29796bd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Dec 14 10:06:23.384517 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: [pid: 86170|app: 0|req: 37/72] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Dec 14 10:06:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:06:23.572832 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG nova.api.openstack.wsgi [None req-4329592b-acef-4aae-b34b-54282e5ba559 admin admin] Calling method '>' {{(pid=86169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:06:23.573978 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:06:23.573978 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: warnings.warn(msg) Dec 14 10:06:23.575641 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-4329592b-acef-4aae-b34b-54282e5ba559 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:06:23.576085 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-4329592b-acef-4aae-b34b-54282e5ba559 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:06:23.576856 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-4329592b-acef-4aae-b34b-54282e5ba559 admin admin] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:06:23.577270 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: DEBUG oslo_concurrency.lockutils [None req-4329592b-acef-4aae-b34b-54282e5ba559 admin admin] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:06:23.603687 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: INFO nova.api.openstack.requestlog [None req-4329592b-acef-4aae-b34b-54282e5ba559 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.079078 Dec 14 10:06:23.604166 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: [pid: 86169|app: 0|req: 36/73] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Dec 14 10:06:23 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:07:18.520886 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: Tue Dec 14 10:07:18 2021 - graceful shutdown triggered... Dec 14 10:07:18.521025 dv-cinder-818885-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 14 10:07:18.522050 dv-cinder-818885-1-iscsi devstack@n-api.service[86170]: Gracefully killing worker 2 (pid: 86170)... Dec 14 10:07:18.522845 dv-cinder-818885-1-iscsi devstack@n-api.service[86169]: Gracefully killing worker 1 (pid: 86169)... Dec 14 10:07:19.523091 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: worker 1 buried after 1 seconds Dec 14 10:07:19.523091 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: worker 2 buried after 1 seconds Dec 14 10:07:19.523091 dv-cinder-818885-1-iscsi devstack@n-api.service[86168]: goodbye to uWSGI. Dec 14 10:07:19.524867 dv-cinder-818885-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 14 10:07:19.525422 dv-cinder-818885-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 14 10:07:19.528235 dv-cinder-818885-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 14 10:07:19.540854 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 14 10:07:19.542920 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Dec 14 10:07:19 2021] *** Dec 14 10:07:19.542920 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 14 10:07:19.542920 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 14 10:07:19.542920 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: nodename: dv-cinder-818885-1-iscsi Dec 14 10:07:19.542920 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: machine: x86_64 Dec 14 10:07:19.542920 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: clock source: unix Dec 14 10:07:19.542920 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: pcre jit disabled Dec 14 10:07:19.542920 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: detected number of CPU cores: 4 Dec 14 10:07:19.542920 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: current working directory: / Dec 14 10:07:19.542920 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: detected binary path: /usr/bin/uwsgi-core Dec 14 10:07:19.543706 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: your processes number limit is 47680 Dec 14 10:07:19.543706 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: your memory page size is 4096 bytes Dec 14 10:07:19.543706 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: detected max file descriptor number: 2048 Dec 14 10:07:19.543706 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: lock engine: pthread robust mutexes Dec 14 10:07:19.543706 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: thunder lock: enabled Dec 14 10:07:19.543706 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 14 10:07:19.543706 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 14 10:07:19.586050 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: Python main interpreter initialized at 0x55ba0b5109c0 Dec 14 10:07:19.586050 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: python threads support enabled Dec 14 10:07:19.586050 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: your server socket listen backlog is limited to 100 connections Dec 14 10:07:19.586050 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: your mercy for graceful operations on workers is 90 seconds Dec 14 10:07:19.586494 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: mapped 403077 bytes (393 KB) for 2 cores Dec 14 10:07:19.586494 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: *** Operational MODE: preforking *** Dec 14 10:07:19.586775 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: *** uWSGI is running in multiple interpreter mode *** Dec 14 10:07:19.586775 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: spawned uWSGI master process (pid: 100964) Dec 14 10:07:19.586985 dv-cinder-818885-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 14 10:07:19.589840 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: spawned uWSGI worker 1 (pid: 100984, cores: 1) Dec 14 10:07:19.589840 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: spawned uWSGI worker 2 (pid: 100985, cores: 1) Dec 14 10:07:19.589840 dv-cinder-818885-1-iscsi devstack@n-api.service[100964]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 14 10:07:23.624029 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 14 10:07:23.624614 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 14 10:07:23.624733 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 14 10:07:23.625093 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 14 10:07:23.625348 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 14 10:07:23.625731 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.626083 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.626405 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.626723 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.627050 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.627359 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.627679 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.627995 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.628320 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.628581 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.628895 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.629218 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818885-1-iscsi {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.629535 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.630418 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.630886 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.631039 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.631343 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.631663 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.631967 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.632461 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.633645 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.633645 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.633918 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 14 10:07:23.634372 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.634450 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 14 10:07:23.634532 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.634614 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 14 10:07:23.634697 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.634775 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 14 10:07:23.634853 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.634929 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 14 10:07:23.635005 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.635075 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.635157 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.635444 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.635547 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.635702 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.635802 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.635986 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818885-1-iscsi {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.636104 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.636303 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.636413 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.636613 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.636722 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.636929 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.637036 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.637257 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.637367 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.637589 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.637698 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.637849 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.638048 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.638217 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.638368 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.638523 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818885-1-iscsi {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.638680 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.638824 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.638972 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.639115 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.639267 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.639419 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.639594 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.639747 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.639901 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.640055 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.640209 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.640366 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.640522 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.640671 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.640814 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.640970 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.641142 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.641319 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.641473 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.641618 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.641781 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.641932 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.642126 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.642271 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.642421 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.642574 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.642729 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.643992 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.644158 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.644316 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.644471 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.644626 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.644626 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.644937 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.645099 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.645253 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.645998 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.646164 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.646309 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.646502 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818885-1-iscsi {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.646651 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.646795 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.646945 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.647098 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.647488 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.647651 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.647802 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.647802 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.648099 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.648252 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.648406 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.648549 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.648691 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.648841 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.648993 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.649136 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.649287 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.649441 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.649842 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.650052 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.650215 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.650372 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.650516 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.650658 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.650799 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.650961 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.651107 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.651262 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.651405 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.651545 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.651703 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.651854 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.652005 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.652157 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.652311 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.652461 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.652603 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.652753 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.652909 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.653052 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.653201 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.653352 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.653512 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.653655 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.653806 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.654003 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.654166 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.654321 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.654464 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.654619 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.654772 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.654916 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.655066 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.655212 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.655370 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.655526 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.655675 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.655827 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.655978 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.656131 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.656282 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.656439 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.656589 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.656741 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.656884 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.657034 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.657178 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.657386 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.657565 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.657710 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.657859 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.658060 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.658210 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.658366 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.658517 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.658666 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.658816 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.658964 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.659119 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.659270 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.659423 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.659572 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.659730 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.659879 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.659879 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.660162 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.660162 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.660440 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.660588 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.660731 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.660731 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.661020 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.661224 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.661383 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.661539 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.661689 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.661904 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.662075 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.662220 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.662362 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.662518 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.662675 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.662826 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.662977 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.663126 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.663287 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.663287 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.663571 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.663721 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.663874 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.664029 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.664183 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.664332 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.664486 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.664669 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.664816 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.664973 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.665124 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.665285 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.665435 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.665587 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.665739 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.665899 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.666095 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.666242 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.666390 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.666540 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.666692 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.666849 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.666993 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.667135 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.667294 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.667439 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.667594 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.667744 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.667896 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.668045 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.668187 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.668347 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.668491 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.668632 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.668784 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.668936 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.669086 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.669250 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.669395 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.669544 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.669698 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.669842 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.670013 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.670173 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.670327 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.670478 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.670630 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.670784 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.670935 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.671098 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.671256 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.671408 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.671550 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.671819 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.672016 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.672182 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.672335 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.672488 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.672632 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.672787 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.672948 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.673099 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.673253 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.673409 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.673561 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.673712 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.673855 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.674027 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.674186 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.674340 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.674491 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.674634 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.674785 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.674928 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.675088 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.675247 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.675390 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.675540 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.675694 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.675846 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.676002 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.676148 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.676290 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.676440 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.677089 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.677245 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.677408 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.677565 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.677715 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.677866 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.678036 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.678186 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.678343 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.678494 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.678651 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.678803 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.678954 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.679098 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.679254 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.679407 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.679567 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.679718 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.679868 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.680020 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.680176 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.680328 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 14 10:07:23.680480 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.680637 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.680793 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.680945 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.681089 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.681238 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.681382 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.681542 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.681686 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.681837 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.682026 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.682191 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.682336 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.682486 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.682629 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.682772 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.682922 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.683065 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.683218 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.683371 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.683522 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.683683 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.683827 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.683975 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.684119 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.684260 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.684401 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.684558 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.684701 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.684844 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.684986 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.685128 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.685279 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.685279 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.685571 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.685571 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.685857 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.685857 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.686217 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.686362 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.686504 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.686648 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.686798 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.686942 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.687093 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.687254 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.687397 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.687547 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.687691 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.687833 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.687989 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.688133 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.688276 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.688418 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.688567 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.688717 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.688874 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.689034 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.689178 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.689331 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.689474 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.689625 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.689769 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.689912 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.690089 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.690241 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.690399 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.690563 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.690720 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.690873 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.691057 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.691203 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.691353 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.691507 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.691658 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.691802 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.691959 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.692111 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.692792 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.692953 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.693097 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.693251 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.693444 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.693607 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.693765 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.693916 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.694083 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.694236 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.694388 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.694388 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.694668 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.694668 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.694955 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.695116 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.695260 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.695409 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.695572 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.695722 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.695866 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.696015 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.696159 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.696301 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.696452 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.696595 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.696736 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.696921 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.697070 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.697226 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.697383 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.697527 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.697677 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.697827 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.698021 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.698184 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.698336 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.698479 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.698621 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.698770 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.698913 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.699104 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.699260 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.699420 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.699572 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.699715 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.699863 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.700020 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.700177 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.700322 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.700478 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.700632 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.700784 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.700934 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.701087 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.701231 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.701384 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.701526 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.701676 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.701818 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.701986 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.702145 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.702297 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.702440 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.702595 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.702745 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.702895 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.703037 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.703186 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.703352 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.703511 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.703655 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.703798 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.703947 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.704089 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.704240 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.704390 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.704534 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.704675 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.704826 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.704969 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.705139 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.705291 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.705433 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.705576 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.705725 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.705867 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.706049 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.706199 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.706348 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.706498 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.706642 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.706790 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.706946 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.707099 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.707249 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.707391 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.707540 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.707696 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.707839 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.708012 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.708200 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.708513 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.708671 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.708862 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.709008 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.709150 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.709312 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.709464 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.709615 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.709769 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.709921 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.710103 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.710256 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.710413 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.710568 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.710725 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.710878 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.711028 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.711179 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.711332 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.711487 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.711630 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.711851 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.712005 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.712149 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.712290 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.712445 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.712596 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.712745 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.712889 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.713031 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.713180 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.713342 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.713494 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.713645 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.713645 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.713925 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.714101 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.714260 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.714412 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.714555 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.714704 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.714855 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.715013 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.715169 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.715312 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.715312 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.715602 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.715745 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.715960 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.716115 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.716258 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.716408 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.716551 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.716700 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.716852 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.716995 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.717160 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.717305 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.717454 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.717605 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.717756 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.717899 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.718117 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.718280 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.718425 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.718576 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.718727 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.718871 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.719012 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.719173 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.719321 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.719480 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.719630 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.719786 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.719942 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.720099 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.720249 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.720249 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.720563 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.720715 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.720871 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.721021 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.721187 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.721350 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.721500 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.721648 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.721804 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.721971 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.722144 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.722298 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.722446 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.722602 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.722758 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.722908 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.723147 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.723307 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.723495 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.723660 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.723951 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.724104 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.724261 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.724413 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.724569 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.724726 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.724884 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.725035 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.725193 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.725362 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.725514 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.725514 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.725796 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.725981 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.726150 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.726310 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.726468 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.726626 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.726783 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.726941 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.727098 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.727248 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.727414 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.727573 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.727723 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.727879 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.727879 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.728178 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.728328 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.728476 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.728632 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.728797 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.728946 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.729094 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.729253 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.729402 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.729558 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.729727 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.729886 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.730101 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.730253 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.730409 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.730575 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.730727 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.730876 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.731025 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.731174 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.731342 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.731501 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.731659 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.731818 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.731818 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.732110 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.732260 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.732421 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.732572 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.732721 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.732877 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.733033 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.733191 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.733358 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.733515 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.733665 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.733814 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.733988 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.734157 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.734315 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.734465 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.734621 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.734770 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.734919 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.735077 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.735234 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.735401 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.735558 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.735708 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.735856 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.736019 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.736177 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.736337 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.736495 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.736653 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.736802 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.736950 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.737100 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.737259 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.737417 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.737575 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.737732 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.737888 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.738098 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.738250 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.738412 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.738562 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.738710 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.738859 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.739006 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.739674 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.739850 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.740000 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.740150 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.740305 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.740472 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.740631 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.740780 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.740937 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.741086 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.741236 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.741384 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.741542 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.741698 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.741858 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.742036 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.742192 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.742342 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.742504 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.742504 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.742799 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.742947 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.743104 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.743268 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.743426 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.743582 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.743733 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.743895 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.744044 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.744203 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.744363 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.744520 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.744677 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.744827 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.744982 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.745150 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.745308 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.745458 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.745607 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.745773 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.745931 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.746151 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.746303 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.746453 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.746602 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.746749 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.746911 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.747061 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.747209 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.747365 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.747515 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.747664 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.747832 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.747982 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.748138 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.748287 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.748447 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.748605 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.748761 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.748909 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.749065 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.749220 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.749379 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.749536 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.749686 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.749844 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.750025 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.750263 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.750421 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.750570 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.750728 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.750892 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.751042 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.751204 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.751354 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.751503 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.751652 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.751800 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.751967 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.752131 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.752289 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.752446 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.752602 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.752752 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.752910 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.753072 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.753229 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.753387 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.753543 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.753699 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.753862 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.754066 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.754221 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.754370 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.754531 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.754731 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.755432 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.755599 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.755750 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.755899 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.756048 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.756204 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.756367 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.756529 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.756686 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.756835 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.756992 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.757149 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.757334 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.757498 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.757649 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.757649 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.757933 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.758122 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.758275 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.758432 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.758593 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.758742 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.758899 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.759063 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.759219 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.759219 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.759514 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.759670 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.759820 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.759984 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.760144 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.760310 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.760468 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.760468 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.760785 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.760945 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.761103 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.761253 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.761402 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.761558 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.761727 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.761886 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.762066 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.762229 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.762387 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.762547 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.762723 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.762881 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.763038 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.763195 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.763346 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.763494 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.763651 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.763808 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.763958 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.764106 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.764255 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.764410 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.764583 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.764733 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.764881 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.765036 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.765187 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.765345 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.765502 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.765658 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.765807 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.766001 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.766169 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.766331 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.766491 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.766651 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.766800 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.766948 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.767103 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.767263 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.768005 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.768160 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.768311 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.768469 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.768629 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.768786 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.768945 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.769111 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.769269 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.769427 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.769589 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.769747 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.769906 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.770267 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.770540 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.770961 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.771117 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.771266 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.771423 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.771585 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.771735 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.771884 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.772094 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.772435 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.772589 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.772748 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.772906 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.773076 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.773227 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.773388 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.773545 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.773704 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.773855 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.774053 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.774211 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.774370 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.774520 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.774930 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.775080 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.775240 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.775389 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.775551 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.775710 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.775867 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.776017 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.776165 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.776165 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.776472 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.776622 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.776770 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.776927 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.777077 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.777244 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.777394 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.777616 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.777768 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.777916 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.778090 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.778090 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.778394 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.778550 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.778707 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.778864 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.779071 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.779240 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.779402 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.779552 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.779708 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.779865 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.780029 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.780227 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.780381 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.780536 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.780686 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.780834 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.781069 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.781259 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.781422 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.781591 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.781742 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.781891 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.782118 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.782314 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.782479 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.782629 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.782629 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.782920 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.783153 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.783313 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.783471 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.783636 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.783794 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.783954 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.784111 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.784274 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.784424 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.784573 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.784721 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.784884 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.785035 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.785184 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.785333 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.785489 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.785649 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.785813 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.786001 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.786151 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.786250 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.786344 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.786480 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.786609 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.786696 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.786779 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.786868 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.786952 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.787043 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.787135 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.787225 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.787310 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.787391 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.787563 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.787658 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.787749 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.787832 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.787922 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.788012 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.788102 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.788197 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.788288 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.788371 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.788459 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.788543 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.788625 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.788716 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.788808 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.788897 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.788980 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.789062 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.789156 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.789241 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.789241 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.789241 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.789445 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.789526 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.789617 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.789700 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.789782 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.789863 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.789944 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.790135 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.790135 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.790321 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.790404 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.790565 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.790651 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.790745 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.790836 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.790920 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.791002 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.791083 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.791165 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.791256 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.791349 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.791433 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.791515 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.791606 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.791702 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.791793 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.791879 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.791962 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.792042 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.792042 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.792042 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.792268 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.792350 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.792458 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.792618 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.792772 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.792948 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.793087 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.793315 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.793406 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.793640 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.793740 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.794007 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.794106 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.794326 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.794434 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.794644 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.794751 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.795103 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.795192 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.795458 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.795550 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.795799 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.795890 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.796114 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.796214 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.796427 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.796518 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.796747 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.796881 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.797060 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.797206 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.797371 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.797526 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.797684 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.797885 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.798008 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.798238 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.798386 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.798554 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.798737 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.798873 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.798978 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.799195 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.799296 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.799511 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.799610 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.799826 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.799922 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.800140 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.800238 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.800474 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.800566 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.800790 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.800888 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.801125 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.801214 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.801464 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.802100 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.802323 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.802644 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.802965 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.803074 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.803282 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.803376 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.803598 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.803697 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.803915 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.804016 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.804228 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.804319 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.804545 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.804670 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.804861 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.805006 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.805175 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.805346 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.805488 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.805689 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.805802 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.806036 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.806140 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.806361 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.806461 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.806715 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.806835 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.807045 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.807153 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.807374 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.807474 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.807686 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.807799 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.808017 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.808202 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.808346 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.808516 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.808672 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.808847 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.808993 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.809170 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.809318 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.809492 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.809644 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.809809 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.809991 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.810150 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.810472 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.810576 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.810776 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.810869 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.811080 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.811179 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.811391 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.811491 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.811701 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.811806 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.812002 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.812101 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.812327 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.812637 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.812763 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.812992 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.813092 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.813312 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.813422 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.813621 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.813721 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.814083 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.814194 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.814425 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.814565 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.814765 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.814868 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.815105 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.815204 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.815434 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.815534 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.815756 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.815849 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.816064 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.816156 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.816388 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.816490 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.816694 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.816809 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.817001 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.817113 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.820145 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.820145 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.820383 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.820488 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.820574 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.820663 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.820761 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.820847 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.820929 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.821011 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.821011 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.821163 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.821254 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.821338 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.821426 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.821508 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.821597 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.821686 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.821797 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.821877 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.821989 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.822088 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.822173 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.822255 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.822335 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.822432 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.822692 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.822791 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.822870 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.822950 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.823071 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.823294 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.823431 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.823609 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.823765 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.823916 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.824093 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.824226 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.824420 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.824520 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.824748 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.824863 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.825128 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.825285 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.825439 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.825614 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.825747 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.825995 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.826309 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.826409 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.826619 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.826702 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.826931 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.827050 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.827251 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.827356 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.827562 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.827662 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.827888 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.827987 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.828202 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.828303 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.828515 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.828615 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.828855 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.828946 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.829168 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.829259 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.829502 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.829695 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.829825 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.830052 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.830149 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.830374 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.830466 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.830718 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.830813 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.831062 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.831312 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.831412 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.831669 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.831769 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.831975 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.832065 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.832304 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.832450 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.832628 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.832759 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.832988 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.833231 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.833362 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.833609 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.833722 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.833994 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.834120 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.834304 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.834420 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.834621 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.834730 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.834931 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.835024 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.835243 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.835343 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.835558 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.835661 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.835880 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.835981 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.836224 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.836347 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.836547 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.836657 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.836863 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.836972 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.837180 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.837288 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.837495 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.837595 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.837809 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.837919 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.838160 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.838273 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.838472 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.838577 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.838782 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.838887 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.839112 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.839217 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.839441 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.839548 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.839767 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.839864 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.840074 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.840181 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.840419 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.840521 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.840744 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.840849 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.841060 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.841170 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.841383 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.841487 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.841703 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.841799 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.842093 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.842208 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.842397 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.842490 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.842745 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.842854 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.843178 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.843486 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.843791 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.844084 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.844189 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.844394 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.844649 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.844745 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.844981 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.845080 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.845309 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.845400 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.845645 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.845737 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.845994 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.846125 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.846341 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.846444 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.846669 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.846754 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.847029 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.847361 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.847361 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.847666 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.847765 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.847852 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.847942 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.848257 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.848352 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.848604 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.848836 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.848937 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.849176 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.849269 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.849520 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.849621 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.849839 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.849931 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.850170 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.850274 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.850484 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.850590 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.850794 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.850895 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.851110 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.851211 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.851445 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.851553 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.851760 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.851860 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.852083 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.852175 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.852395 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.852497 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.852717 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.852946 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.853089 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.853205 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.853490 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.853642 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.853793 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.853935 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.854120 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.854260 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.854423 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.854571 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.854733 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.854885 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.854976 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.855069 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.855162 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.855254 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.855471 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.855574 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.855787 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.855890 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.856095 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.856188 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.856410 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.856535 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.856738 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.856886 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.857062 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.857165 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.857368 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.857470 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.857693 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.857802 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.858031 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.858135 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.858352 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.858474 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.858667 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.858777 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.858975 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.859083 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.859300 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.859400 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.859611 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.859712 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.859926 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.860103 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.860264 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.860370 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.860545 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.860714 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.860883 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.861065 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.861168 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.861402 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.861498 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.861734 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.861830 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.862090 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.862187 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.862451 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.862565 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.862716 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.862817 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.863037 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.863142 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.863393 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.863492 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.863730 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.863836 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.863960 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 14 10:07:23.864678 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.865074 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.865472 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.865798 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.866734 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.866734 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.867074 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.867318 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.867728 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.867986 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.868315 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.868638 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.868972 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.869290 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.869623 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.870082 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.870410 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.870731 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.871056 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.871398 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.871721 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.872052 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.872376 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.872705 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.873023 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.873359 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.873691 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.874046 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.874370 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.874709 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.875023 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.875343 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.875661 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.875976 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.876292 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.876608 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.876943 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.877275 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.877587 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.877917 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.878263 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.878589 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.878908 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.879224 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.879557 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.880467 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.880791 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.881110 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.881430 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.881753 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.882099 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.882434 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.882767 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.883103 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.883430 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.883782 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.884108 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.884448 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.884779 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 14 10:07:23.885027 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 14 10:07:23.905347 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_db.sqlalchemy.engines [None req-55b8f807-935b-4953-bb80-3e53e71b5305 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 14 10:07:23.918780 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_db.sqlalchemy.engines [None req-7ead25a8-93dc-4d4d-838d-276aad58eb2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 14 10:07:24.155566 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.context [None req-55b8f807-935b-4953-bb80-3e53e71b5305 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),26d0cb61-6736-4223-b055-fa824f7338a4(cell1) {{(pid=100984) load_cells /opt/stack/nova/nova/context.py:464}} Dec 14 10:07:24.159780 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-55b8f807-935b-4953-bb80-3e53e71b5305 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:07:24.162058 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-55b8f807-935b-4953-bb80-3e53e71b5305 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:07:24.162873 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-55b8f807-935b-4953-bb80-3e53e71b5305 None None] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:07:24.164926 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-55b8f807-935b-4953-bb80-3e53e71b5305 None None] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:07:24.170087 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.context [None req-7ead25a8-93dc-4d4d-838d-276aad58eb2c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),26d0cb61-6736-4223-b055-fa824f7338a4(cell1) {{(pid=100985) load_cells /opt/stack/nova/nova/context.py:464}} Dec 14 10:07:24.174392 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7ead25a8-93dc-4d4d-838d-276aad58eb2c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:07:24.176059 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7ead25a8-93dc-4d4d-838d-276aad58eb2c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:07:24.181757 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7ead25a8-93dc-4d4d-838d-276aad58eb2c None None] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:07:24.183904 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7ead25a8-93dc-4d4d-838d-276aad58eb2c None None] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:07:24.189932 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_db.sqlalchemy.engines [None req-55b8f807-935b-4953-bb80-3e53e71b5305 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 14 10:07:24.191013 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_db.sqlalchemy.engines [None req-55b8f807-935b-4953-bb80-3e53e71b5305 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 14 10:07:24.208610 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_db.sqlalchemy.engines [None req-7ead25a8-93dc-4d4d-838d-276aad58eb2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 14 10:07:24.209427 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_db.sqlalchemy.engines [None req-7ead25a8-93dc-4d4d-838d-276aad58eb2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 14 10:07:24.220801 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_db.sqlalchemy.engines [None req-55b8f807-935b-4953-bb80-3e53e71b5305 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 14 10:07:24.238320 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_db.sqlalchemy.engines [None req-7ead25a8-93dc-4d4d-838d-276aad58eb2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 14 10:07:24.464475 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO keyring.backend [None req-55b8f807-935b-4953-bb80-3e53e71b5305 None None] Loading KWallet Dec 14 10:07:24.473517 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO keyring.backend [None req-55b8f807-935b-4953-bb80-3e53e71b5305 None None] Loading SecretService Dec 14 10:07:24.477977 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 10:07:24.477977 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: from cryptography.utils import int_from_bytes Dec 14 10:07:24.478317 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 10:07:24.478317 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: from cryptography.utils import int_from_bytes Dec 14 10:07:24.479047 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO keyring.backend [None req-55b8f807-935b-4953-bb80-3e53e71b5305 None None] Loading Windows Dec 14 10:07:24.480019 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO keyring.backend [None req-7ead25a8-93dc-4d4d-838d-276aad58eb2c None None] Loading KWallet Dec 14 10:07:24.480945 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO keyring.backend [None req-55b8f807-935b-4953-bb80-3e53e71b5305 None None] Loading chainer Dec 14 10:07:24.481746 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO keyring.backend [None req-55b8f807-935b-4953-bb80-3e53e71b5305 None None] Loading macOS Dec 14 10:07:24.489527 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO keyring.backend [None req-7ead25a8-93dc-4d4d-838d-276aad58eb2c None None] Loading SecretService Dec 14 10:07:24.493837 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 10:07:24.493837 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: from cryptography.utils import int_from_bytes Dec 14 10:07:24.494224 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 14 10:07:24.494224 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: from cryptography.utils import int_from_bytes Dec 14 10:07:24.495021 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO keyring.backend [None req-7ead25a8-93dc-4d4d-838d-276aad58eb2c None None] Loading Windows Dec 14 10:07:24.496938 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO keyring.backend [None req-7ead25a8-93dc-4d4d-838d-276aad58eb2c None None] Loading chainer Dec 14 10:07:24.497744 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO keyring.backend [None req-7ead25a8-93dc-4d4d-838d-276aad58eb2c None None] Loading macOS Dec 14 10:07:24.768146 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: WARNING keystonemiddleware.auth_token [None req-7ead25a8-93dc-4d4d-838d-276aad58eb2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 10:07:24.775406 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: WARNING keystonemiddleware.auth_token [None req-7ead25a8-93dc-4d4d-838d-276aad58eb2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 10:07:24.783935 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: WARNING keystonemiddleware.auth_token [None req-55b8f807-935b-4953-bb80-3e53e71b5305 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 10:07:24.792128 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: WARNING keystonemiddleware.auth_token [None req-55b8f807-935b-4953-bb80-3e53e71b5305 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 10:07:25.021206 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: WARNING keystonemiddleware.auth_token [None req-7ead25a8-93dc-4d4d-838d-276aad58eb2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 10:07:25.027272 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: WARNING keystonemiddleware.auth_token [None req-7ead25a8-93dc-4d4d-838d-276aad58eb2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 10:07:25.033229 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ba0b5109c0 pid: 100985 (default app) Dec 14 10:07:25.054899 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: WARNING keystonemiddleware.auth_token [None req-55b8f807-935b-4953-bb80-3e53e71b5305 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 14 10:07:25.060457 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: WARNING keystonemiddleware.auth_token [None req-55b8f807-935b-4953-bb80-3e53e71b5305 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 14 10:07:25.066901 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ba0b5109c0 pid: 100984 (default app) Dec 14 10:08:10.101218 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-2325288e-6abc-4aa4-8b5d-0934aeed6771 tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] Action: 'create', calling method: .version_select at 0x7fb17b075d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1572099570", "metadata": {"Type": "work"}}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:10.116926 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-2325288e-6abc-4aa4-8b5d-0934aeed6771 tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:08:10.119792 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-2325288e-6abc-4aa4-8b5d-0934aeed6771 tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.327539 Dec 14 10:08:10.125546 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Dec 14 10:08:08 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1334 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 14 10:08:10.283887 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8fb830bc-cc01-498e-b892-0b23cd33087c tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Action: 'create', calling method: .version_select at 0x7fb17b076d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-514185900"}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:10.436956 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a9d3aa80-dcc5-4727-9db8-314ac9912620 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-618364136", "imageRef": "5be36fdc-2baa-4efd-b830-5a5c3fd7beba", "flavorRef": "452", "networks": [{"uuid": "fcd0582b-f091-4bb6-bfce-2519464100b0"}]}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:11.259174 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.network.neutron [None req-a9d3aa80-dcc5-4727-9db8-314ac9912620 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] validate_networks() for [('fcd0582b-f091-4bb6-bfce-2519464100b0', None, None, None)] {{(pid=100985) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:08:11.528389 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8fb830bc-cc01-498e-b892-0b23cd33087c tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.438595 Dec 14 10:08:11.529321 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 1/2] 10.222.0.20 () {60 vars in 1154 bytes} [Tue Dec 14 10:08:09 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 2442 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 14 10:08:11.541194 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-61e5324b-2263-4486-8c94-f3abed52b11b tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] Action: 'create', calling method: .version_select at 0x7fb17aff2790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-348166575", "metadata": {"Type": "work"}}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:11.543549 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-61e5324b-2263-4486-8c94-f3abed52b11b tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:08:11.544729 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-61e5324b-2263-4486-8c94-f3abed52b11b tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013816 Dec 14 10:08:11.545779 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Dec 14 10:08:11 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 14 10:08:11.562302 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d71a3dbd-5ab1-4280-b846-a2c8ce64f3f5 tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] Calling method '.version_select at 0x7fb17b56b940>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:11.680359 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d71a3dbd-5ab1-4280-b846-a2c8ce64f3f5 tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/0b4703b6-d8d0-4a9b-973c-34544f697b7e" status: 200 len: 351 microversion: 2.1 time: 0.133326 Dec 14 10:08:11.681259 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 3/4] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Dec 14 10:08:11 2021] GET /compute/v2.1/os-volumes/0b4703b6-d8d0-4a9b-973c-34544f697b7e => generated 351 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:11.801530 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-10dab5f3-1a65-43d8-bae2-354f3e3bc6e6 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-783866607", "imageRef": "5be36fdc-2baa-4efd-b830-5a5c3fd7beba", "flavorRef": "452", "networks": [{"uuid": "b3e5f9c3-89a4-4893-939b-76a4f92dc189"}]}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:11.983228 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.network.neutron [None req-10dab5f3-1a65-43d8-bae2-354f3e3bc6e6 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] validate_networks() for [('b3e5f9c3-89a4-4893-939b-76a4f92dc189', None, None, None)] {{(pid=100984) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:08:13.302092 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-a9d3aa80-dcc5-4727-9db8-314ac9912620 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Flavor limits 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:08:13.303272 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-a9d3aa80-dcc5-4727-9db8-314ac9912620 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Image limits 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:08:13.303972 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-a9d3aa80-dcc5-4727-9db8-314ac9912620 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Flavor pref 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:08:13.304648 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-a9d3aa80-dcc5-4727-9db8-314ac9912620 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Image pref 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:08:13.305281 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-a9d3aa80-dcc5-4727-9db8-314ac9912620 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:08:13.330243 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a9d3aa80-dcc5-4727-9db8-314ac9912620 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:13.333416 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a9d3aa80-dcc5-4727-9db8-314ac9912620 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:13.334967 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a9d3aa80-dcc5-4727-9db8-314ac9912620 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:13.337318 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a9d3aa80-dcc5-4727-9db8-314ac9912620 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:13.407435 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-a9d3aa80-dcc5-4727-9db8-314ac9912620 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Getting quotas for project 55d21e35946242e9b067686ed5f812ac. Resources: {'cores', 'instances', 'ram'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:08:13.417498 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-a9d3aa80-dcc5-4727-9db8-314ac9912620 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Getting quotas for user 61ac29796a444ae88d119870a479baa9 and project 55d21e35946242e9b067686ed5f812ac. Resources: {'cores', 'instances', 'ram'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:08:13.436891 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a9d3aa80-dcc5-4727-9db8-314ac9912620 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Going to run 1 instances... {{(pid=100985) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:08:13.439800 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a9d3aa80-dcc5-4727-9db8-314ac9912620 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5be36fdc-2baa-4efd-b830-5a5c3fd7beba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:08:13.514498 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-10dab5f3-1a65-43d8-bae2-354f3e3bc6e6 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Flavor limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:08:13.516667 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-10dab5f3-1a65-43d8-bae2-354f3e3bc6e6 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Image limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:08:13.517440 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-10dab5f3-1a65-43d8-bae2-354f3e3bc6e6 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Flavor pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:08:13.518085 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-10dab5f3-1a65-43d8-bae2-354f3e3bc6e6 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Image pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:08:13.519024 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-10dab5f3-1a65-43d8-bae2-354f3e3bc6e6 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:08:13.542686 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-10dab5f3-1a65-43d8-bae2-354f3e3bc6e6 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:13.543226 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-10dab5f3-1a65-43d8-bae2-354f3e3bc6e6 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:13.544363 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-10dab5f3-1a65-43d8-bae2-354f3e3bc6e6 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:13.546366 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-10dab5f3-1a65-43d8-bae2-354f3e3bc6e6 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:13.589763 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-10dab5f3-1a65-43d8-bae2-354f3e3bc6e6 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Getting quotas for project c185d9933ced42d0b30077f0febbc3b7. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:08:13.598479 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a9d3aa80-dcc5-4727-9db8-314ac9912620 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.471006 Dec 14 10:08:13.604284 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 2/5] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Dec 14 10:08:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 3473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 10:08:13.604592 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-10dab5f3-1a65-43d8-bae2-354f3e3bc6e6 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Getting quotas for user ff2574f3d80644ac8d45f5e1be1c342c and project c185d9933ced42d0b30077f0febbc3b7. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:08:13.607928 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e13c41c8-8b21-4c99-bc47-fdedde3cd547 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Calling method '.version_select at 0x7fb17aed7160>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:13.634830 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-10dab5f3-1a65-43d8-bae2-354f3e3bc6e6 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Going to run 1 instances... {{(pid=100984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:08:13.643895 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-10dab5f3-1a65-43d8-bae2-354f3e3bc6e6 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5be36fdc-2baa-4efd-b830-5a5c3fd7beba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:08:13.795213 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-10dab5f3-1a65-43d8-bae2-354f3e3bc6e6 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.112728 Dec 14 10:08:13.795838 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 4/6] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Dec 14 10:08:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 10:08:13.806865 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-09f0909a-1bc8-4bf6-8e36-e00d2e5a1bb5 tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] Action: 'create', calling method: .version_select at 0x7fb17aeadf70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1884564082", "metadata": {"Type": "work"}}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:13.808168 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-09f0909a-1bc8-4bf6-8e36-e00d2e5a1bb5 tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:08:13.808813 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-09f0909a-1bc8-4bf6-8e36-e00d2e5a1bb5 tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006345 Dec 14 10:08:13.809334 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 5/7] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Dec 14 10:08:13 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 14 10:08:13.825338 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-45083823-047d-4a37-a2a8-417b18874906 tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] Calling method '.version_select at 0x7fb17ae3eca0>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:13.889067 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e13c41c8-8b21-4c99-bc47-fdedde3cd547 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2ff9ac9e-1a60-4c8b-bf6e-71b2b5ceebc0" status: 200 len: 345 microversion: 2.1 time: 0.288074 Dec 14 10:08:13.889664 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 3/8] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Dec 14 10:08:13 2021] GET /compute/v2.1/os-volumes/2ff9ac9e-1a60-4c8b-bf6e-71b2b5ceebc0 => generated 345 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:13.897549 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-cb190876-0013-437d-a224-faa0bc891ec6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:13.901184 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-cb190876-0013-437d-a224-faa0bc891ec6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:14.067626 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-45083823-047d-4a37-a2a8-417b18874906 tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/538ee480-9b2d-4211-a770-471d6042dbc6" status: 200 len: 350 microversion: 2.1 time: 0.245816 Dec 14 10:08:14.068178 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 6/9] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Dec 14 10:08:13 2021] GET /compute/v2.1/os-volumes/538ee480-9b2d-4211-a770-471d6042dbc6 => generated 350 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:14.072784 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e13e261b-ea15-4e49-a030-3cf106c84234 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:14.073560 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e13e261b-ea15-4e49-a030-3cf106c84234 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:14.294687 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e13e261b-ea15-4e49-a030-3cf106c84234 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:14.311278 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e13e261b-ea15-4e49-a030-3cf106c84234 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1214 microversion: 2.1 time: 0.240823 Dec 14 10:08:14.311969 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 7/10] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:14 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1214 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:14.328749 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-6275f306-1474-4db8-9ffc-9c1c7e51f0e5 tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] Calling method '.version_select at 0x7fb17b13f8b0>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:14.426624 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-6275f306-1474-4db8-9ffc-9c1c7e51f0e5 tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] HTTP exception thrown: Volume tempest-invalid-918221391 could not be found. Dec 14 10:08:14.427213 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-6275f306-1474-4db8-9ffc-9c1c7e51f0e5 tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] Returning 404 to user: Volume tempest-invalid-918221391 could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:08:14.428197 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-6275f306-1474-4db8-9ffc-9c1c7e51f0e5 tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-918221391" status: 404 len: 98 microversion: 2.1 time: 0.113160 Dec 14 10:08:14.428734 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 8/11] 10.222.0.20 () {58 vars in 1214 bytes} [Tue Dec 14 10:08:14 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-918221391 => generated 98 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 14 10:08:14.436662 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-363249fd-249e-4cda-b5fc-4ff6346e0416 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Action: 'create', calling method: .version_select at 0x7fb17af5f670>, body: {"snapshot": {"volume_id": "2ff9ac9e-1a60-4c8b-bf6e-71b2b5ceebc0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1720401171"}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:14.444679 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-cb190876-0013-437d-a224-faa0bc891ec6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:14.478916 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-cb190876-0013-437d-a224-faa0bc891ec6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1217 microversion: 2.1 time: 0.586212 Dec 14 10:08:14.483372 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 4/12] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:13 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1217 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:14.496957 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-1e3a0fde-345c-408c-985a-b7d4442f89a0 tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007628 Dec 14 10:08:14.503695 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 5/13] 10.222.0.20 () {58 vars in 1139 bytes} [Tue Dec 14 10:08:14 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 14 10:08:14.508909 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-fd3ea846-0211-4dd3-8fc8-dbe775d700c1 tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004088 Dec 14 10:08:14.514368 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 6/14] 10.222.0.20 () {58 vars in 1136 bytes} [Tue Dec 14 10:08:14 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 14 10:08:14.530985 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-8183eab4-e7e4-4a0b-8bda-b0d09e2f4684 tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] Calling method '.version_select at 0x7fb17af84820>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:14.922083 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-8183eab4-e7e4-4a0b-8bda-b0d09e2f4684 tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] HTTP exception thrown: Volume a22dc587-307a-4363-ab41-a9a73837f5a8 could not be found. Dec 14 10:08:14.923040 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-8183eab4-e7e4-4a0b-8bda-b0d09e2f4684 tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] Returning 404 to user: Volume a22dc587-307a-4363-ab41-a9a73837f5a8 could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:08:14.924208 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-8183eab4-e7e4-4a0b-8bda-b0d09e2f4684 tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/a22dc587-307a-4363-ab41-a9a73837f5a8" status: 404 len: 109 microversion: 2.1 time: 0.402111 Dec 14 10:08:14.933026 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 7/15] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Dec 14 10:08:14 2021] DELETE /compute/v2.1/os-volumes/a22dc587-307a-4363-ab41-a9a73837f5a8 => generated 109 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:08:14.940644 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3d359398-e5ae-4097-89b3-c48c05e4d6fb tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] Calling method '.version_select at 0x7fb17afe7280>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:15.046785 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-363249fd-249e-4cda-b5fc-4ff6346e0416 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.616836 Dec 14 10:08:15.047364 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 9/16] 10.222.0.20 () {60 vars in 1161 bytes} [Tue Dec 14 10:08:14 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:15.057823 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-0036897f-6a29-44bc-ab2f-e62ee46bc16a tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Calling method '.version_select at 0x7fb17ae50040>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:15.215603 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-0036897f-6a29-44bc-ab2f-e62ee46bc16a tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e8d626df-e573-4b86-a1ad-cd6a7cb97f24" status: 200 len: 287 microversion: 2.1 time: 0.161418 Dec 14 10:08:15.216436 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 10/17] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Dec 14 10:08:15 2021] GET /compute/v2.1/os-snapshots/e8d626df-e573-4b86-a1ad-cd6a7cb97f24 => generated 287 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:08:15.226467 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-aea1def8-3eac-4956-b515-933459ced13e tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Calling method '.version_select at 0x7fb17ae56ee0>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:15.247657 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-3d359398-e5ae-4097-89b3-c48c05e4d6fb tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] HTTP exception thrown: Volume 51008b27-fe50-4f63-b2da-47fd490bc234 could not be found. Dec 14 10:08:15.248482 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3d359398-e5ae-4097-89b3-c48c05e4d6fb tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] Returning 404 to user: Volume 51008b27-fe50-4f63-b2da-47fd490bc234 could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:08:15.249551 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3d359398-e5ae-4097-89b3-c48c05e4d6fb tempest-VolumesNegativeTest-872713811 tempest-VolumesNegativeTest-872713811-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/51008b27-fe50-4f63-b2da-47fd490bc234" status: 404 len: 109 microversion: 2.1 time: 0.314330 Dec 14 10:08:15.260763 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 8/18] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Dec 14 10:08:14 2021] GET /compute/v2.1/os-volumes/51008b27-fe50-4f63-b2da-47fd490bc234 => generated 109 bytes in 327 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:08:15.282501 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-aea1def8-3eac-4956-b515-933459ced13e tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.059785 Dec 14 10:08:15.283587 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 11/19] 10.222.0.20 () {58 vars in 1139 bytes} [Tue Dec 14 10:08:15 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:08:15.296064 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f8668280-819f-4b18-a199-8a067444dc79 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Calling method '.version_select at 0x7fb17a653af0>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:15.329916 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-2c7d2042-f3ad-4fe8-9117-af95cc636b84 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:15.330641 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-2c7d2042-f3ad-4fe8-9117-af95cc636b84 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:15.411519 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f8668280-819f-4b18-a199-8a067444dc79 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e8d626df-e573-4b86-a1ad-cd6a7cb97f24" status: 200 len: 287 microversion: 2.1 time: 0.119608 Dec 14 10:08:15.412466 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 9/20] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Dec 14 10:08:15 2021] GET /compute/v2.1/os-snapshots/e8d626df-e573-4b86-a1ad-cd6a7cb97f24 => generated 287 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:15.499810 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-64cd26eb-f771-4d64-90c5-9100228acbc8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:15.500560 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-64cd26eb-f771-4d64-90c5-9100228acbc8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:15.576637 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-2c7d2042-f3ad-4fe8-9117-af95cc636b84 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:15.590832 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-2c7d2042-f3ad-4fe8-9117-af95cc636b84 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1214 microversion: 2.1 time: 0.261992 Dec 14 10:08:15.591447 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 12/21] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:15 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1214 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:08:15.668764 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-64cd26eb-f771-4d64-90c5-9100228acbc8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:15.677881 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-64cd26eb-f771-4d64-90c5-9100228acbc8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1217 microversion: 2.1 time: 0.181298 Dec 14 10:08:15.679540 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 10/22] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:15 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:16.257426 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c28a81d1-f4c9-4943-8806-d7aabf89e474 tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] Calling method '.version_select at 0x7fb17ae451f0>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:16.423641 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-50880326-6d83-465f-9283-1a36b589987e tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Calling method '.version_select at 0x7fb17af84b80>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:16.472333 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c28a81d1-f4c9-4943-8806-d7aabf89e474 tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/52c8f5f4-929f-4397-88a9-680f3cfe21f4" status: 200 len: 350 microversion: 2.1 time: 0.219677 Dec 14 10:08:16.473397 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 13/23] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Dec 14 10:08:16 2021] GET /compute/v2.1/os-volumes/52c8f5f4-929f-4397-88a9-680f3cfe21f4 => generated 350 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:16.484408 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d3967a11-2cdb-4ceb-a33e-c7b3ae4c0dbf tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] Calling method '.version_select at 0x7fb17ae56700>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:16.517738 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-50880326-6d83-465f-9283-1a36b589987e tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e8d626df-e573-4b86-a1ad-cd6a7cb97f24" status: 200 len: 287 microversion: 2.1 time: 0.097643 Dec 14 10:08:16.518323 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 11/24] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Dec 14 10:08:16 2021] GET /compute/v2.1/os-snapshots/e8d626df-e573-4b86-a1ad-cd6a7cb97f24 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:16.613682 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-ffae2cde-c575-4f1d-b216-bee7f702b2be tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:16.614336 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-ffae2cde-c575-4f1d-b216-bee7f702b2be tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:16.626155 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ffae2cde-c575-4f1d-b216-bee7f702b2be tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:16.626600 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ffae2cde-c575-4f1d-b216-bee7f702b2be tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:16.627376 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ffae2cde-c575-4f1d-b216-bee7f702b2be tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:16.627863 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ffae2cde-c575-4f1d-b216-bee7f702b2be tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:16.675461 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d3967a11-2cdb-4ceb-a33e-c7b3ae4c0dbf tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.194130 Dec 14 10:08:16.676122 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 14/25] 10.222.0.20 () {58 vars in 1133 bytes} [Tue Dec 14 10:08:16 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:16.688129 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-73874156-47b8-41b5-8892-e1228a644ce1 tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] Calling method '.version_select at 0x7fb17aeaddc0>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:16.860836 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-73874156-47b8-41b5-8892-e1228a644ce1 tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.176291 Dec 14 10:08:16.861665 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 15/26] 10.222.0.20 () {58 vars in 1148 bytes} [Tue Dec 14 10:08:16 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:16.867285 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-7f5fec7e-ffac-44ac-8c05-8353a7efc725 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:16.867959 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-7f5fec7e-ffac-44ac-8c05-8353a7efc725 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:16.886720 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7f5fec7e-ffac-44ac-8c05-8353a7efc725 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:16.887168 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7f5fec7e-ffac-44ac-8c05-8353a7efc725 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:16.887971 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7f5fec7e-ffac-44ac-8c05-8353a7efc725 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:16.892511 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7f5fec7e-ffac-44ac-8c05-8353a7efc725 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:17.000845 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-ffae2cde-c575-4f1d-b216-bee7f702b2be tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:17.029124 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-ffae2cde-c575-4f1d-b216-bee7f702b2be tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1218 microversion: 2.1 time: 0.419550 Dec 14 10:08:17.030005 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 12/27] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:16 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1218 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:08:17.034746 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-28280325-8a04-4b8a-b38b-cb4cb7d03840 tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] Calling method '.version_select at 0x7fb17a5cc790>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:17.228105 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-28280325-8a04-4b8a-b38b-cb4cb7d03840 tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.196873 Dec 14 10:08:17.229907 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 13/28] 10.222.0.20 () {58 vars in 1133 bytes} [Tue Dec 14 10:08:17 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:17.242059 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e5af18de-efed-4586-ba89-a163e7cb0b47 tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] Calling method '.version_select at 0x7fb17a6623a0>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:17.265782 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-7f5fec7e-ffac-44ac-8c05-8353a7efc725 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:17.294919 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-7f5fec7e-ffac-44ac-8c05-8353a7efc725 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1221 microversion: 2.1 time: 0.431560 Dec 14 10:08:17.302338 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 16/29] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:16 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1221 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:17.419660 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e5af18de-efed-4586-ba89-a163e7cb0b47 tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.182160 Dec 14 10:08:17.420001 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 14/30] 10.222.0.20 () {58 vars in 1166 bytes} [Tue Dec 14 10:08:17 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:17.433464 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-cdf86b6b-65c8-4cb5-87ad-a9fac81b3259 tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] Calling method '.version_select at 0x7fb17a5e0ca0>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:17.529868 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a9d51963-d252-4713-a5be-51bb258495bd tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Calling method '.version_select at 0x7fb17af84310>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:17.596357 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-cdf86b6b-65c8-4cb5-87ad-a9fac81b3259 tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.167314 Dec 14 10:08:17.597064 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 17/31] 10.222.0.20 () {58 vars in 1169 bytes} [Tue Dec 14 10:08:17 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:17.609399 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-97fe05a4-84a7-4304-a84d-a8c0f482f46a tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] Calling method '.version_select at 0x7fb17a5ea0d0>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:17.616669 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a9d51963-d252-4713-a5be-51bb258495bd tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e8d626df-e573-4b86-a1ad-cd6a7cb97f24" status: 200 len: 287 microversion: 2.1 time: 0.090780 Dec 14 10:08:17.621099 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 15/32] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Dec 14 10:08:17 2021] GET /compute/v2.1/os-snapshots/e8d626df-e573-4b86-a1ad-cd6a7cb97f24 => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:17.736255 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-97fe05a4-84a7-4304-a84d-a8c0f482f46a tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.131010 Dec 14 10:08:17.743666 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 18/33] 10.222.0.20 () {58 vars in 1154 bytes} [Tue Dec 14 10:08:17 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:17.748604 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-70d2d3f5-0bb8-4689-abbd-09cebcae48cf tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] Calling method '.version_select at 0x7fb17a5dfca0>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:17.880514 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-70d2d3f5-0bb8-4689-abbd-09cebcae48cf tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.135431 Dec 14 10:08:17.881353 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 16/34] 10.222.0.20 () {58 vars in 1187 bytes} [Tue Dec 14 10:08:17 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:17.894617 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-6f410ab3-4a06-4dcd-aa93-4323dd26afcb tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] Calling method '.version_select at 0x7fb17a5caca0>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:18.038823 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-6f410ab3-4a06-4dcd-aa93-4323dd26afcb tempest-VolumesTestJSON-1868637184 tempest-VolumesTestJSON-1868637184-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.148076 Dec 14 10:08:18.039764 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 19/35] 10.222.0.20 () {58 vars in 1154 bytes} [Tue Dec 14 10:08:17 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:18.045667 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c455b4ba-b25b-46ae-a6ce-aa3af1acc5de tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:18.047811 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c455b4ba-b25b-46ae-a6ce-aa3af1acc5de tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:18.065489 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c455b4ba-b25b-46ae-a6ce-aa3af1acc5de tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:18.067194 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c455b4ba-b25b-46ae-a6ce-aa3af1acc5de tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:18.069436 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c455b4ba-b25b-46ae-a6ce-aa3af1acc5de tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:18.070863 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c455b4ba-b25b-46ae-a6ce-aa3af1acc5de tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:18.321493 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-291f9e02-85f6-4773-8fac-1323b6048c72 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:18.324080 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-291f9e02-85f6-4773-8fac-1323b6048c72 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:18.345105 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-291f9e02-85f6-4773-8fac-1323b6048c72 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:18.347870 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-291f9e02-85f6-4773-8fac-1323b6048c72 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:18.350816 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-291f9e02-85f6-4773-8fac-1323b6048c72 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:18.352900 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-291f9e02-85f6-4773-8fac-1323b6048c72 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:18.482868 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-c455b4ba-b25b-46ae-a6ce-aa3af1acc5de tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:18.495267 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c455b4ba-b25b-46ae-a6ce-aa3af1acc5de tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1218 microversion: 2.1 time: 0.453212 Dec 14 10:08:18.496343 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 17/36] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:18 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1218 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:18.630312 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-5694c1c0-3e94-4a86-a05f-ef912035ba58 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Calling method '.version_select at 0x7fb17a5dfca0>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:18.673286 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-291f9e02-85f6-4773-8fac-1323b6048c72 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:18.691388 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-291f9e02-85f6-4773-8fac-1323b6048c72 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1221 microversion: 2.1 time: 0.370693 Dec 14 10:08:18.695511 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 20/37] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:18 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1221 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:18.734601 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-5694c1c0-3e94-4a86-a05f-ef912035ba58 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e8d626df-e573-4b86-a1ad-cd6a7cb97f24" status: 200 len: 287 microversion: 2.1 time: 0.108432 Dec 14 10:08:18.735292 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 18/38] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Dec 14 10:08:18 2021] GET /compute/v2.1/os-snapshots/e8d626df-e573-4b86-a1ad-cd6a7cb97f24 => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:08:19.512624 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c486088d-4cd8-4893-9e5b-0cc2c1cdea1c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:19.513239 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c486088d-4cd8-4893-9e5b-0cc2c1cdea1c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:19.530199 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c486088d-4cd8-4893-9e5b-0cc2c1cdea1c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:19.537971 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c486088d-4cd8-4893-9e5b-0cc2c1cdea1c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:19.543353 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c486088d-4cd8-4893-9e5b-0cc2c1cdea1c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:19.548042 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c486088d-4cd8-4893-9e5b-0cc2c1cdea1c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:19.711276 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-952751bd-940d-47fb-9fd0-35b771904cd5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:19.712205 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-952751bd-940d-47fb-9fd0-35b771904cd5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:19.736914 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-952751bd-940d-47fb-9fd0-35b771904cd5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:19.741423 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-952751bd-940d-47fb-9fd0-35b771904cd5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:19.742756 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-952751bd-940d-47fb-9fd0-35b771904cd5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:19.746436 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-952751bd-940d-47fb-9fd0-35b771904cd5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:20.135703 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c486088d-4cd8-4893-9e5b-0cc2c1cdea1c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:20.156420 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c486088d-4cd8-4893-9e5b-0cc2c1cdea1c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1266 microversion: 2.1 time: 0.647317 Dec 14 10:08:20.161862 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 21/39] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:19 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1266 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:20.181979 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-ac16086a-9b3c-4b84-b501-df84fcc198e5 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Calling method '.version_select at 0x7fb17ae3e790>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:20.331851 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-ac16086a-9b3c-4b84-b501-df84fcc198e5 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e8d626df-e573-4b86-a1ad-cd6a7cb97f24" status: 200 len: 288 microversion: 2.1 time: 0.157680 Dec 14 10:08:20.339504 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 22/40] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Dec 14 10:08:20 2021] GET /compute/v2.1/os-snapshots/e8d626df-e573-4b86-a1ad-cd6a7cb97f24 => generated 288 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:20.358205 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-fcae348a-be91-4003-9270-27b5b4d8d6f3 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Calling method '.version_select at 0x7fb17a5e0a60>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:20.538245 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-952751bd-940d-47fb-9fd0-35b771904cd5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:20.553780 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-952751bd-940d-47fb-9fd0-35b771904cd5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1277 microversion: 2.1 time: 0.844670 Dec 14 10:08:20.559953 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 19/41] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:19 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1277 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:08:20.840879 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-fcae348a-be91-4003-9270-27b5b4d8d6f3 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/e8d626df-e573-4b86-a1ad-cd6a7cb97f24" status: 202 len: 0 microversion: 2.1 time: 0.499701 Dec 14 10:08:20.841446 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 23/42] 10.222.0.20 () {58 vars in 1253 bytes} [Tue Dec 14 10:08:20 2021] DELETE /compute/v2.1/os-snapshots/e8d626df-e573-4b86-a1ad-cd6a7cb97f24 => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:08:20.851531 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-ac23b10c-fdd0-4d34-b970-0c28910121aa tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Calling method '.version_select at 0x7fb17a5dfc10>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:20.975351 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-ac23b10c-fdd0-4d34-b970-0c28910121aa tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e8d626df-e573-4b86-a1ad-cd6a7cb97f24" status: 200 len: 287 microversion: 2.1 time: 0.128647 Dec 14 10:08:20.976401 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 20/43] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Dec 14 10:08:20 2021] GET /compute/v2.1/os-snapshots/e8d626df-e573-4b86-a1ad-cd6a7cb97f24 => generated 287 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:21.173688 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4c9de902-5887-479f-9052-82a5b379ebfa tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:21.175511 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4c9de902-5887-479f-9052-82a5b379ebfa tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:21.210444 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4c9de902-5887-479f-9052-82a5b379ebfa tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:21.211120 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4c9de902-5887-479f-9052-82a5b379ebfa tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:21.213843 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4c9de902-5887-479f-9052-82a5b379ebfa tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:21.214477 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4c9de902-5887-479f-9052-82a5b379ebfa tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:21.428606 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4c9de902-5887-479f-9052-82a5b379ebfa tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:21.445399 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4c9de902-5887-479f-9052-82a5b379ebfa tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1272 microversion: 2.1 time: 0.275448 Dec 14 10:08:21.446583 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 24/44] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:21 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1272 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:21.579261 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b2def434-9b0b-4fa7-995a-ba1b773c0142 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:21.580045 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-b2def434-9b0b-4fa7-995a-ba1b773c0142 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:21.605841 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b2def434-9b0b-4fa7-995a-ba1b773c0142 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:21.607898 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b2def434-9b0b-4fa7-995a-ba1b773c0142 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:21.615587 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b2def434-9b0b-4fa7-995a-ba1b773c0142 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:21.619728 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b2def434-9b0b-4fa7-995a-ba1b773c0142 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:21.931663 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-b2def434-9b0b-4fa7-995a-ba1b773c0142 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:21.940927 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-b2def434-9b0b-4fa7-995a-ba1b773c0142 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1275 microversion: 2.1 time: 0.365352 Dec 14 10:08:21.950364 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 21/45] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:21 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1275 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:22.004476 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a521e44b-cc88-43f9-99a3-2f684d53dfdb tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Calling method '.version_select at 0x7fb17a5eaca0>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:22.133181 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-a521e44b-cc88-43f9-99a3-2f684d53dfdb tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] HTTP exception thrown: Snapshot e8d626df-e573-4b86-a1ad-cd6a7cb97f24 could not be found. Dec 14 10:08:22.133885 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a521e44b-cc88-43f9-99a3-2f684d53dfdb tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Returning 404 to user: Snapshot e8d626df-e573-4b86-a1ad-cd6a7cb97f24 could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:08:22.135396 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a521e44b-cc88-43f9-99a3-2f684d53dfdb tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e8d626df-e573-4b86-a1ad-cd6a7cb97f24" status: 404 len: 111 microversion: 2.1 time: 0.143637 Dec 14 10:08:22.136140 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 25/46] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Dec 14 10:08:21 2021] GET /compute/v2.1/os-snapshots/e8d626df-e573-4b86-a1ad-cd6a7cb97f24 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:08:22.145456 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-07613c96-34f4-4f3c-916c-7e6f277cca30 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Calling method '.version_select at 0x7fb17a574430>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:22.366129 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-07613c96-34f4-4f3c-916c-7e6f277cca30 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/2ff9ac9e-1a60-4c8b-bf6e-71b2b5ceebc0" status: 202 len: 0 microversion: 2.1 time: 0.225156 Dec 14 10:08:22.367398 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 22/47] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Dec 14 10:08:22 2021] DELETE /compute/v2.1/os-volumes/2ff9ac9e-1a60-4c8b-bf6e-71b2b5ceebc0 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:08:22.375708 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c490c9d5-7587-46fa-b1eb-2803a5f4ec41 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Calling method '.version_select at 0x7fb17a53d0d0>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:22.463191 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-ef0ca642-eb5f-469d-a0db-6fd4f1c3ff61 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:22.464117 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-ef0ca642-eb5f-469d-a0db-6fd4f1c3ff61 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:22.496156 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ef0ca642-eb5f-469d-a0db-6fd4f1c3ff61 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:22.499164 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ef0ca642-eb5f-469d-a0db-6fd4f1c3ff61 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:22.501122 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ef0ca642-eb5f-469d-a0db-6fd4f1c3ff61 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:22.504106 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ef0ca642-eb5f-469d-a0db-6fd4f1c3ff61 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:22.637477 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c490c9d5-7587-46fa-b1eb-2803a5f4ec41 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2ff9ac9e-1a60-4c8b-bf6e-71b2b5ceebc0" status: 200 len: 344 microversion: 2.1 time: 0.265792 Dec 14 10:08:22.639332 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 26/48] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Dec 14 10:08:22 2021] GET /compute/v2.1/os-volumes/2ff9ac9e-1a60-4c8b-bf6e-71b2b5ceebc0 => generated 344 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:22.961818 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-fcfc27eb-fc84-495f-87cd-cbf727edac9c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:22.962673 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-fcfc27eb-fc84-495f-87cd-cbf727edac9c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:22.979010 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fcfc27eb-fc84-495f-87cd-cbf727edac9c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:22.979618 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fcfc27eb-fc84-495f-87cd-cbf727edac9c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:22.980503 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fcfc27eb-fc84-495f-87cd-cbf727edac9c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:22.981045 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fcfc27eb-fc84-495f-87cd-cbf727edac9c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:23.147664 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-ef0ca642-eb5f-469d-a0db-6fd4f1c3ff61 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:23.166989 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-ef0ca642-eb5f-469d-a0db-6fd4f1c3ff61 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1272 microversion: 2.1 time: 0.707521 Dec 14 10:08:23.175773 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 23/49] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:22 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1272 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:23.653205 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-35db9f3f-3b47-4364-b039-b3a9f575aeb8 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Calling method '.version_select at 0x7fb17a5df4c0>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:23.769333 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-35db9f3f-3b47-4364-b039-b3a9f575aeb8 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] HTTP exception thrown: Volume 2ff9ac9e-1a60-4c8b-bf6e-71b2b5ceebc0 could not be found. Dec 14 10:08:23.770176 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-35db9f3f-3b47-4364-b039-b3a9f575aeb8 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Returning 404 to user: Volume 2ff9ac9e-1a60-4c8b-bf6e-71b2b5ceebc0 could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:08:23.771167 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-35db9f3f-3b47-4364-b039-b3a9f575aeb8 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2ff9ac9e-1a60-4c8b-bf6e-71b2b5ceebc0" status: 404 len: 109 microversion: 2.1 time: 0.122738 Dec 14 10:08:23.771844 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 24/50] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Dec 14 10:08:23 2021] GET /compute/v2.1/os-volumes/2ff9ac9e-1a60-4c8b-bf6e-71b2b5ceebc0 => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:08:23.816356 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-4a7ad972-87e1-4ba1-b5f5-da4bd2b955d8 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Calling method '.version_select at 0x7fb17a5744c0>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:23.950925 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-4a7ad972-87e1-4ba1-b5f5-da4bd2b955d8 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] HTTP exception thrown: Volume 2ff9ac9e-1a60-4c8b-bf6e-71b2b5ceebc0 could not be found. Dec 14 10:08:23.951686 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-4a7ad972-87e1-4ba1-b5f5-da4bd2b955d8 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Returning 404 to user: Volume 2ff9ac9e-1a60-4c8b-bf6e-71b2b5ceebc0 could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:08:23.952648 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-4a7ad972-87e1-4ba1-b5f5-da4bd2b955d8 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/2ff9ac9e-1a60-4c8b-bf6e-71b2b5ceebc0" status: 404 len: 109 microversion: 2.1 time: 0.153569 Dec 14 10:08:23.962813 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 25/51] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Dec 14 10:08:23 2021] DELETE /compute/v2.1/os-volumes/2ff9ac9e-1a60-4c8b-bf6e-71b2b5ceebc0 => generated 109 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:08:23.969517 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-aff2b6da-8512-4a8e-840e-58b8aafe67b1 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Calling method '.version_select at 0x7fb17a5df5e0>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:24.073080 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-aff2b6da-8512-4a8e-840e-58b8aafe67b1 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] HTTP exception thrown: Volume 2ff9ac9e-1a60-4c8b-bf6e-71b2b5ceebc0 could not be found. Dec 14 10:08:24.073684 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-aff2b6da-8512-4a8e-840e-58b8aafe67b1 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] Returning 404 to user: Volume 2ff9ac9e-1a60-4c8b-bf6e-71b2b5ceebc0 could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:08:24.074746 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-aff2b6da-8512-4a8e-840e-58b8aafe67b1 tempest-VolumesSnapshotsTestJSON-249690464 tempest-VolumesSnapshotsTestJSON-249690464-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2ff9ac9e-1a60-4c8b-bf6e-71b2b5ceebc0" status: 404 len: 109 microversion: 2.1 time: 0.110427 Dec 14 10:08:24.075313 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 26/52] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Dec 14 10:08:23 2021] GET /compute/v2.1/os-volumes/2ff9ac9e-1a60-4c8b-bf6e-71b2b5ceebc0 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:08:24.189039 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-2066c1d4-776d-42a9-8abc-67c1ea6e63ca tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:24.189892 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-2066c1d4-776d-42a9-8abc-67c1ea6e63ca tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:24.211996 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2066c1d4-776d-42a9-8abc-67c1ea6e63ca tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:24.214588 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2066c1d4-776d-42a9-8abc-67c1ea6e63ca tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:24.215603 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2066c1d4-776d-42a9-8abc-67c1ea6e63ca tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:24.216048 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2066c1d4-776d-42a9-8abc-67c1ea6e63ca tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:24.301528 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-fcfc27eb-fc84-495f-87cd-cbf727edac9c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:24.322830 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-fcfc27eb-fc84-495f-87cd-cbf727edac9c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1275 microversion: 2.1 time: 1.354019 Dec 14 10:08:24.323479 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 27/53] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:22 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1275 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:24.639190 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-2066c1d4-776d-42a9-8abc-67c1ea6e63ca tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:24.657635 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-2066c1d4-776d-42a9-8abc-67c1ea6e63ca tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1272 microversion: 2.1 time: 0.473034 Dec 14 10:08:24.665521 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 27/54] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:24 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1272 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:25.360525 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3b859d0f-c1be-4acb-b4cb-6af68603c95e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:25.361188 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3b859d0f-c1be-4acb-b4cb-6af68603c95e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:25.389685 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3b859d0f-c1be-4acb-b4cb-6af68603c95e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:25.392407 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3b859d0f-c1be-4acb-b4cb-6af68603c95e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:25.393691 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3b859d0f-c1be-4acb-b4cb-6af68603c95e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:25.396362 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3b859d0f-c1be-4acb-b4cb-6af68603c95e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:26.481703 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3b859d0f-c1be-4acb-b4cb-6af68603c95e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:26.498308 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a00693af-c20c-41f8-8474-fd08fdb496c6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'create', calling method: .version_select at 0x7fb17a5ca160>, body: {"keypair": {"name": "tempest-keypair-1263408341"}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:26.529039 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3b859d0f-c1be-4acb-b4cb-6af68603c95e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1317 microversion: 2.1 time: 1.183501 Dec 14 10:08:26.539722 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 28/55] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:25 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1317 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:26.539722 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-be740abd-37d6-455c-933f-b78a0412ec57 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:26.539722 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-be740abd-37d6-455c-933f-b78a0412ec57 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:26.567492 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-be740abd-37d6-455c-933f-b78a0412ec57 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:26.567941 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-be740abd-37d6-455c-933f-b78a0412ec57 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:26.568722 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-be740abd-37d6-455c-933f-b78a0412ec57 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:26.569154 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-be740abd-37d6-455c-933f-b78a0412ec57 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:26.589102 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-a00693af-c20c-41f8-8474-fd08fdb496c6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Getting quotas for project d66bc312475a4c749b82c1f077f8fff7. Resources: {'key_pairs'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:08:26.618981 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-a00693af-c20c-41f8-8474-fd08fdb496c6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Getting quotas for user e2bd13a8087149c797727e140ec7d387 and project d66bc312475a4c749b82c1f077f8fff7. Resources: {'key_pairs'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:08:26.966391 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-a00693af-c20c-41f8-8474-fd08fdb496c6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Getting quotas for project d66bc312475a4c749b82c1f077f8fff7. Resources: {'key_pairs'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:08:26.980179 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-a00693af-c20c-41f8-8474-fd08fdb496c6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Getting quotas for user e2bd13a8087149c797727e140ec7d387 and project d66bc312475a4c749b82c1f077f8fff7. Resources: {'key_pairs'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:08:27.014867 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a00693af-c20c-41f8-8474-fd08fdb496c6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.704991 Dec 14 10:08:27.016062 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 28/56] 10.222.0.20 () {60 vars in 1157 bytes} [Tue Dec 14 10:08:25 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:27.237771 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-be740abd-37d6-455c-933f-b78a0412ec57 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:27.247612 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-be740abd-37d6-455c-933f-b78a0412ec57 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1314 microversion: 2.1 time: 0.715951 Dec 14 10:08:27.259210 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 29/57] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:26 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:27.547148 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-55989912-95fb-461b-9484-ff102ef043f8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:27.548602 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-55989912-95fb-461b-9484-ff102ef043f8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:27.565938 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-55989912-95fb-461b-9484-ff102ef043f8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:27.570269 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-55989912-95fb-461b-9484-ff102ef043f8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:27.579536 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-55989912-95fb-461b-9484-ff102ef043f8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:27.579989 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-55989912-95fb-461b-9484-ff102ef043f8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:28.084604 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5917c985-2047-4f27-951c-9da47dfd4782 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-218208179", "imageRef": "5be36fdc-2baa-4efd-b830-5a5c3fd7beba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16176ada-a401-430e-83a6-e6937490a230"}]}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:28.266278 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.network.neutron [None req-5917c985-2047-4f27-951c-9da47dfd4782 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] validate_networks() for [('16176ada-a401-430e-83a6-e6937490a230', None, None, None)] {{(pid=100984) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:08:28.988344 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-55989912-95fb-461b-9484-ff102ef043f8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:29.014688 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-55989912-95fb-461b-9484-ff102ef043f8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1317 microversion: 2.1 time: 1.464698 Dec 14 10:08:29.016041 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 30/58] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:27 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1317 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:08:29.034685 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-88033216-7cf3-4c5f-919d-77ba3ec9e417 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:29.035953 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-88033216-7cf3-4c5f-919d-77ba3ec9e417 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:29.055352 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-88033216-7cf3-4c5f-919d-77ba3ec9e417 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:29.057325 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-88033216-7cf3-4c5f-919d-77ba3ec9e417 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:29.058873 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-88033216-7cf3-4c5f-919d-77ba3ec9e417 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:29.059928 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-88033216-7cf3-4c5f-919d-77ba3ec9e417 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:30.643080 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-88033216-7cf3-4c5f-919d-77ba3ec9e417 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:30.654443 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-88033216-7cf3-4c5f-919d-77ba3ec9e417 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1314 microversion: 2.1 time: 1.636869 Dec 14 10:08:30.655616 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 31/59] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:29 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1314 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:30.661235 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-34a2b118-e0b6-4514-ad52-1349f00a810c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:30.662864 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-34a2b118-e0b6-4514-ad52-1349f00a810c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:30.674939 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-34a2b118-e0b6-4514-ad52-1349f00a810c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:30.686297 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-34a2b118-e0b6-4514-ad52-1349f00a810c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:30.688869 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-34a2b118-e0b6-4514-ad52-1349f00a810c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:30.692523 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-34a2b118-e0b6-4514-ad52-1349f00a810c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:31.675685 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-34a2b118-e0b6-4514-ad52-1349f00a810c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:31.692350 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-34a2b118-e0b6-4514-ad52-1349f00a810c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1317 microversion: 2.1 time: 1.035292 Dec 14 10:08:31.695265 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 32/60] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:30 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1317 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:31.704811 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3a74c032-2300-4ba2-9530-2033d5fa6c6e tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:31.708259 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3a74c032-2300-4ba2-9530-2033d5fa6c6e tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:31.732795 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3a74c032-2300-4ba2-9530-2033d5fa6c6e tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:31.735405 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3a74c032-2300-4ba2-9530-2033d5fa6c6e tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:31.736546 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3a74c032-2300-4ba2-9530-2033d5fa6c6e tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:31.738916 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3a74c032-2300-4ba2-9530-2033d5fa6c6e tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:33.548292 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3a74c032-2300-4ba2-9530-2033d5fa6c6e tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:33.560952 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3a74c032-2300-4ba2-9530-2033d5fa6c6e tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1314 microversion: 2.1 time: 1.864404 Dec 14 10:08:33.565470 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 33/61] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:31 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1314 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:33.581587 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-13686828-2ecd-4c74-a481-98d23daa76e8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:33.582738 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-13686828-2ecd-4c74-a481-98d23daa76e8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:33.593520 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-13686828-2ecd-4c74-a481-98d23daa76e8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:33.598627 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-13686828-2ecd-4c74-a481-98d23daa76e8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:33.600380 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-13686828-2ecd-4c74-a481-98d23daa76e8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:33.601153 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-13686828-2ecd-4c74-a481-98d23daa76e8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:33.775604 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-5917c985-2047-4f27-951c-9da47dfd4782 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Flavor limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:08:33.776614 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-5917c985-2047-4f27-951c-9da47dfd4782 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Image limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:08:33.777217 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-5917c985-2047-4f27-951c-9da47dfd4782 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Flavor pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:08:33.778429 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-5917c985-2047-4f27-951c-9da47dfd4782 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Image pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:08:33.779661 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-5917c985-2047-4f27-951c-9da47dfd4782 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:08:33.799282 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5917c985-2047-4f27-951c-9da47dfd4782 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:33.801455 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5917c985-2047-4f27-951c-9da47dfd4782 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:33.803693 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5917c985-2047-4f27-951c-9da47dfd4782 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:33.804317 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5917c985-2047-4f27-951c-9da47dfd4782 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:33.852795 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-5917c985-2047-4f27-951c-9da47dfd4782 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Getting quotas for project f5695583eab44670bb4a5057d81beb15. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:08:33.876943 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-5917c985-2047-4f27-951c-9da47dfd4782 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Getting quotas for user 8bd42ec3da644dbeb47be466cc1abba8 and project f5695583eab44670bb4a5057d81beb15. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:08:33.909205 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5917c985-2047-4f27-951c-9da47dfd4782 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Going to run 1 instances... {{(pid=100984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:08:33.911434 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5917c985-2047-4f27-951c-9da47dfd4782 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5be36fdc-2baa-4efd-b830-5a5c3fd7beba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:08:33.988430 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5917c985-2047-4f27-951c-9da47dfd4782 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.971051 Dec 14 10:08:33.995510 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 29/62] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Dec 14 10:08:27 2021] POST /compute/v2.1/servers => generated 383 bytes in 6979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 10:08:34.001840 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-b842983c-e442-4f90-8055-7a36d96dc8df tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:34.003216 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-b842983c-e442-4f90-8055-7a36d96dc8df tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:34.232487 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-b842983c-e442-4f90-8055-7a36d96dc8df tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:34.248296 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-b842983c-e442-4f90-8055-7a36d96dc8df tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1221 microversion: 2.1 time: 0.249488 Dec 14 10:08:34.271957 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 30/63] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:33 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1221 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:35.253003 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-f9c1b0ae-d7ac-46c9-9279-81f0bac6388a req-7a3fda85-692f-4a96-9b32-a40adfa336d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b66506-2460-4284-aa1e-c7b2f368bb75", "tag": "3b355350-b30b-4000-9798-cdf47cd7eb43"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:35.257069 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:08:35.257069 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:08:35.290714 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-f9c1b0ae-d7ac-46c9-9279-81f0bac6388a req-7a3fda85-692f-4a96-9b32-a40adfa336d2 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:35.292335 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-f9c1b0ae-d7ac-46c9-9279-81f0bac6388a req-7a3fda85-692f-4a96-9b32-a40adfa336d2 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:35.361166 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-f9c1b0ae-d7ac-46c9-9279-81f0bac6388a req-7a3fda85-692f-4a96-9b32-a40adfa336d2 service nova] Creating event network-changed:3b355350-b30b-4000-9798-cdf47cd7eb43 for instance 35b66506-2460-4284-aa1e-c7b2f368bb75 on hv-cinder-81888 Dec 14 10:08:35.367741 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-f9c1b0ae-d7ac-46c9-9279-81f0bac6388a req-7a3fda85-692f-4a96-9b32-a40adfa336d2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=100984) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 14 10:08:35.367741 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-69f97a46-e0bc-4bdc-b8f6-7b32f56ce930 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:35.367741 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-69f97a46-e0bc-4bdc-b8f6-7b32f56ce930 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:35.367741 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-69f97a46-e0bc-4bdc-b8f6-7b32f56ce930 None None] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:35.367741 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-69f97a46-e0bc-4bdc-b8f6-7b32f56ce930 None None] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:35.375826 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.compute.rpcapi [None req-69f97a46-e0bc-4bdc-b8f6-7b32f56ce930 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Dec 14 10:08:35.376893 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-69f97a46-e0bc-4bdc-b8f6-7b32f56ce930 None None] Releasing lock "compute-rpcapi-router" {{(pid=100984) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 14 10:08:35.424850 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-69f97a46-e0bc-4bdc-b8f6-7b32f56ce930 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.040528 Dec 14 10:08:35.425844 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 31/64] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:08:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:08:35.446226 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-acd6330a-6c34-46c8-a835-4f7326d98ed7 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:35.447602 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-acd6330a-6c34-46c8-a835-4f7326d98ed7 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:35.469898 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-acd6330a-6c34-46c8-a835-4f7326d98ed7 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:35.470725 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-acd6330a-6c34-46c8-a835-4f7326d98ed7 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:35.472098 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-acd6330a-6c34-46c8-a835-4f7326d98ed7 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:35.472867 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-acd6330a-6c34-46c8-a835-4f7326d98ed7 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:35.880028 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-13686828-2ecd-4c74-a481-98d23daa76e8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:35.889546 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-13686828-2ecd-4c74-a481-98d23daa76e8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1317 microversion: 2.1 time: 2.322536 Dec 14 10:08:35.891065 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 34/65] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:33 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1317 bytes in 2325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:35.897008 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-511185c3-2774-4133-ad80-13fa130593c6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1824626328", "imageRef": "5be36fdc-2baa-4efd-b830-5a5c3fd7beba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16176ada-a401-430e-83a6-e6937490a230"}]}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:35.992283 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.network.neutron [None req-511185c3-2774-4133-ad80-13fa130593c6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] validate_networks() for [('16176ada-a401-430e-83a6-e6937490a230', None, None, None)] {{(pid=100985) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:08:36.135666 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-acd6330a-6c34-46c8-a835-4f7326d98ed7 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:36.144355 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-acd6330a-6c34-46c8-a835-4f7326d98ed7 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1314 microversion: 2.1 time: 0.716990 Dec 14 10:08:36.144939 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 32/66] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:35 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1314 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:36.361589 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-f35fe2cb-c68e-4269-8441-56f94b386382 req-f5bb8e41-8dd2-4c55-9cc1-8756ffbd81a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e89d5e41-df1a-438d-b051-8b9dd0104644", "tag": "b88f6614-94a6-49ff-aab2-e715637e1e86"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:36.363256 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:08:36.363256 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:08:36.380932 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-f35fe2cb-c68e-4269-8441-56f94b386382 req-f5bb8e41-8dd2-4c55-9cc1-8756ffbd81a5 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:36.381384 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-f35fe2cb-c68e-4269-8441-56f94b386382 req-f5bb8e41-8dd2-4c55-9cc1-8756ffbd81a5 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:36.430249 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-f35fe2cb-c68e-4269-8441-56f94b386382 req-f5bb8e41-8dd2-4c55-9cc1-8756ffbd81a5 service nova] Creating event network-changed:b88f6614-94a6-49ff-aab2-e715637e1e86 for instance e89d5e41-df1a-438d-b051-8b9dd0104644 on hv-cinder-81888 Dec 14 10:08:36.435787 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-f35fe2cb-c68e-4269-8441-56f94b386382 req-f5bb8e41-8dd2-4c55-9cc1-8756ffbd81a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.286676 Dec 14 10:08:36.437323 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 33/67] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:08:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:36.918818 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-820f8015-37b8-4457-80ea-b02117e2490d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:36.919971 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-820f8015-37b8-4457-80ea-b02117e2490d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:36.935095 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-820f8015-37b8-4457-80ea-b02117e2490d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:36.936933 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-820f8015-37b8-4457-80ea-b02117e2490d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:36.937803 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-820f8015-37b8-4457-80ea-b02117e2490d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:36.938500 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-820f8015-37b8-4457-80ea-b02117e2490d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:38.271491 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-820f8015-37b8-4457-80ea-b02117e2490d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:38.288080 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-820f8015-37b8-4457-80ea-b02117e2490d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1317 microversion: 2.1 time: 1.381318 Dec 14 10:08:38.290682 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 34/68] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:36 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1317 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:38.295929 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f9a88194-88be-4b22-9ae3-3ba7ce684afc tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:38.296681 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f9a88194-88be-4b22-9ae3-3ba7ce684afc tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:38.307315 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f9a88194-88be-4b22-9ae3-3ba7ce684afc tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:38.307932 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f9a88194-88be-4b22-9ae3-3ba7ce684afc tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:38.309087 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f9a88194-88be-4b22-9ae3-3ba7ce684afc tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:38.309529 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f9a88194-88be-4b22-9ae3-3ba7ce684afc tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:38.600313 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-f9a88194-88be-4b22-9ae3-3ba7ce684afc tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:38.610221 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f9a88194-88be-4b22-9ae3-3ba7ce684afc tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1314 microversion: 2.1 time: 0.318124 Dec 14 10:08:38.623703 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 35/69] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:38 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:38.623703 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-01a089b5-4bff-48c3-8c64-1d3cf03294c5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1331625581", "imageRef": "5be36fdc-2baa-4efd-b830-5a5c3fd7beba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33aca229-a8a6-4405-be53-80fe67a86208"}], "security_groups": [{"name": "tempest-securitygroup--1284092055"}], "key_name": "tempest-keypair-1263408341", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:38.648111 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-511185c3-2774-4133-ad80-13fa130593c6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Flavor limits 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:08:38.649988 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-511185c3-2774-4133-ad80-13fa130593c6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Image limits 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:08:38.650621 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-511185c3-2774-4133-ad80-13fa130593c6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Flavor pref 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:08:38.651166 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-511185c3-2774-4133-ad80-13fa130593c6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Image pref 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:08:38.651713 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-511185c3-2774-4133-ad80-13fa130593c6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:08:38.667979 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-511185c3-2774-4133-ad80-13fa130593c6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:38.669238 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-511185c3-2774-4133-ad80-13fa130593c6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:38.671239 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-511185c3-2774-4133-ad80-13fa130593c6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:38.671684 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-511185c3-2774-4133-ad80-13fa130593c6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:38.703811 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-511185c3-2774-4133-ad80-13fa130593c6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Getting quotas for project f5695583eab44670bb4a5057d81beb15. Resources: {'cores', 'instances', 'ram'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:08:38.708720 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-511185c3-2774-4133-ad80-13fa130593c6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Getting quotas for user 8bd42ec3da644dbeb47be466cc1abba8 and project f5695583eab44670bb4a5057d81beb15. Resources: {'cores', 'instances', 'ram'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:08:38.719654 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-511185c3-2774-4133-ad80-13fa130593c6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Going to run 1 instances... {{(pid=100985) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:08:38.722862 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-511185c3-2774-4133-ad80-13fa130593c6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5be36fdc-2baa-4efd-b830-5a5c3fd7beba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:08:38.789300 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.network.neutron [None req-01a089b5-4bff-48c3-8c64-1d3cf03294c5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] validate_networks() for [('33aca229-a8a6-4405-be53-80fe67a86208', None, None, None)] {{(pid=100984) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:08:38.794319 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-511185c3-2774-4133-ad80-13fa130593c6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.901927 Dec 14 10:08:38.795511 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 35/70] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Dec 14 10:08:35 2021] POST /compute/v2.1/servers => generated 383 bytes in 2903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 10:08:38.808840 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-062e423b-7f66-43cd-b96d-fba287753a20 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:38.810391 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-062e423b-7f66-43cd-b96d-fba287753a20 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:39.124991 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-062e423b-7f66-43cd-b96d-fba287753a20 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:39.135615 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-062e423b-7f66-43cd-b96d-fba287753a20 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1222 microversion: 2.1 time: 0.333905 Dec 14 10:08:39.136260 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 36/71] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:38 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1222 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:39.306087 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-5e94fad5-a5d3-4782-98c3-dba7cefa1129 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:39.306708 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-5e94fad5-a5d3-4782-98c3-dba7cefa1129 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:39.314075 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5e94fad5-a5d3-4782-98c3-dba7cefa1129 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:39.315089 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5e94fad5-a5d3-4782-98c3-dba7cefa1129 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:39.316084 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5e94fad5-a5d3-4782-98c3-dba7cefa1129 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:39.316534 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5e94fad5-a5d3-4782-98c3-dba7cefa1129 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:40.172588 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-5e94fad5-a5d3-4782-98c3-dba7cefa1129 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:40.207590 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-5e94fad5-a5d3-4782-98c3-dba7cefa1129 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1317 microversion: 2.1 time: 0.903914 Dec 14 10:08:40.210177 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 37/72] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:39 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1317 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:08:40.220373 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-434eb06e-2109-41c3-a2ca-da438df49e5c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:40.222589 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-434eb06e-2109-41c3-a2ca-da438df49e5c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:40.238260 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-434eb06e-2109-41c3-a2ca-da438df49e5c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:40.240886 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-434eb06e-2109-41c3-a2ca-da438df49e5c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:40.247233 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-434eb06e-2109-41c3-a2ca-da438df49e5c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:40.250668 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-434eb06e-2109-41c3-a2ca-da438df49e5c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:40.298362 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-01a089b5-4bff-48c3-8c64-1d3cf03294c5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Flavor limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:08:40.299318 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-01a089b5-4bff-48c3-8c64-1d3cf03294c5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Image limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:08:40.299865 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-01a089b5-4bff-48c3-8c64-1d3cf03294c5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Flavor pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:08:40.300337 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-01a089b5-4bff-48c3-8c64-1d3cf03294c5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Image pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:08:40.301373 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-01a089b5-4bff-48c3-8c64-1d3cf03294c5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:08:40.319511 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-01a089b5-4bff-48c3-8c64-1d3cf03294c5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:40.319644 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-01a089b5-4bff-48c3-8c64-1d3cf03294c5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:40.332350 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-01a089b5-4bff-48c3-8c64-1d3cf03294c5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:40.334816 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-01a089b5-4bff-48c3-8c64-1d3cf03294c5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:40.396239 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-01a089b5-4bff-48c3-8c64-1d3cf03294c5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Getting quotas for project d66bc312475a4c749b82c1f077f8fff7. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:08:40.412452 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-01a089b5-4bff-48c3-8c64-1d3cf03294c5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Getting quotas for user e2bd13a8087149c797727e140ec7d387 and project d66bc312475a4c749b82c1f077f8fff7. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:08:40.451301 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-01a089b5-4bff-48c3-8c64-1d3cf03294c5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Going to run 1 instances... {{(pid=100984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:08:40.454880 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-01a089b5-4bff-48c3-8c64-1d3cf03294c5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5be36fdc-2baa-4efd-b830-5a5c3fd7beba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:08:40.582299 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-01a089b5-4bff-48c3-8c64-1d3cf03294c5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.964113 Dec 14 10:08:40.583045 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 36/73] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Dec 14 10:08:38 2021] POST /compute/v2.1/servers => generated 402 bytes in 1965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 10:08:40.597793 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-19213309-bd2b-4a8e-af62-82faedc1c3d0 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:40.598975 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-19213309-bd2b-4a8e-af62-82faedc1c3d0 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:40.607765 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-19213309-bd2b-4a8e-af62-82faedc1c3d0 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:40.608385 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-19213309-bd2b-4a8e-af62-82faedc1c3d0 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:40.610182 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-19213309-bd2b-4a8e-af62-82faedc1c3d0 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:40.613056 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-19213309-bd2b-4a8e-af62-82faedc1c3d0 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:40.837790 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-19213309-bd2b-4a8e-af62-82faedc1c3d0 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:40.847129 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-19213309-bd2b-4a8e-af62-82faedc1c3d0 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1280 microversion: 2.1 time: 0.262738 Dec 14 10:08:40.847599 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 37/74] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:40 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1280 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:40.869857 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-06f9efe4-359e-4dd3-89b6-3bc86a4a4d10 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:40.870512 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-06f9efe4-359e-4dd3-89b6-3bc86a4a4d10 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:41.103859 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-06f9efe4-359e-4dd3-89b6-3bc86a4a4d10 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:41.115479 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-06f9efe4-359e-4dd3-89b6-3bc86a4a4d10 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1238 microversion: 2.1 time: 0.248967 Dec 14 10:08:41.116761 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 38/75] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:40 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1238 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:41.133730 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-434eb06e-2109-41c3-a2ca-da438df49e5c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:41.142058 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-434eb06e-2109-41c3-a2ca-da438df49e5c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1314 microversion: 2.1 time: 0.930488 Dec 14 10:08:41.156877 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 38/76] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:40 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1314 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:41.231176 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-49b6f0aa-cc38-4c1c-93d3-78f918c1975b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:41.231803 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-49b6f0aa-cc38-4c1c-93d3-78f918c1975b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:41.243659 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49b6f0aa-cc38-4c1c-93d3-78f918c1975b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:41.244117 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49b6f0aa-cc38-4c1c-93d3-78f918c1975b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:41.245117 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49b6f0aa-cc38-4c1c-93d3-78f918c1975b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:41.245859 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49b6f0aa-cc38-4c1c-93d3-78f918c1975b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:41.865425 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b83c6660-9365-4c30-8d5c-b88d09f48e68 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:41.866967 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-b83c6660-9365-4c30-8d5c-b88d09f48e68 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:41.891650 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b83c6660-9365-4c30-8d5c-b88d09f48e68 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:41.892628 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b83c6660-9365-4c30-8d5c-b88d09f48e68 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:41.894531 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b83c6660-9365-4c30-8d5c-b88d09f48e68 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:41.895181 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b83c6660-9365-4c30-8d5c-b88d09f48e68 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:42.128547 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-49b6f0aa-cc38-4c1c-93d3-78f918c1975b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:42.137947 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-49b6f0aa-cc38-4c1c-93d3-78f918c1975b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1317 microversion: 2.1 time: 0.910715 Dec 14 10:08:42.153152 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 39/77] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:41 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1317 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:42.166487 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e9e7a79b-8acf-4454-b7f3-e3ba6f369427 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:42.167120 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e9e7a79b-8acf-4454-b7f3-e3ba6f369427 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:42.180558 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e9e7a79b-8acf-4454-b7f3-e3ba6f369427 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:42.181011 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e9e7a79b-8acf-4454-b7f3-e3ba6f369427 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:42.185427 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e9e7a79b-8acf-4454-b7f3-e3ba6f369427 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:42.188985 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e9e7a79b-8acf-4454-b7f3-e3ba6f369427 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:42.291095 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-b83c6660-9365-4c30-8d5c-b88d09f48e68 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:42.316118 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-b83c6660-9365-4c30-8d5c-b88d09f48e68 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1280 microversion: 2.1 time: 0.455353 Dec 14 10:08:42.319417 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 39/78] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:41 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1280 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:42.331439 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-9bcc5395-1b69-42bb-8d3e-6529c9839875 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:42.332104 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-9bcc5395-1b69-42bb-8d3e-6529c9839875 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:42.355438 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9bcc5395-1b69-42bb-8d3e-6529c9839875 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:42.355887 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9bcc5395-1b69-42bb-8d3e-6529c9839875 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:42.356667 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9bcc5395-1b69-42bb-8d3e-6529c9839875 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:42.357160 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9bcc5395-1b69-42bb-8d3e-6529c9839875 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:42.406441 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e9e7a79b-8acf-4454-b7f3-e3ba6f369427 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:42.422254 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e9e7a79b-8acf-4454-b7f3-e3ba6f369427 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1290 microversion: 2.1 time: 0.263905 Dec 14 10:08:42.427380 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 40/79] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:42 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1290 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:42.448459 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-56bc41c3-f036-4a5c-aacd-eba8e8d8af5d req-2cec3e6c-0a2b-4ea7-8662-66d779dba150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b4bf45-d284-4fcf-acc0-610f2a7b7dcd", "tag": "7a526190-4919-4594-99c3-7109b540bd6f"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:42.452709 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:08:42.452709 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:08:42.473911 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-56bc41c3-f036-4a5c-aacd-eba8e8d8af5d req-2cec3e6c-0a2b-4ea7-8662-66d779dba150 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:42.477570 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-56bc41c3-f036-4a5c-aacd-eba8e8d8af5d req-2cec3e6c-0a2b-4ea7-8662-66d779dba150 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:42.512366 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-56bc41c3-f036-4a5c-aacd-eba8e8d8af5d req-2cec3e6c-0a2b-4ea7-8662-66d779dba150 service nova] Creating event network-changed:7a526190-4919-4594-99c3-7109b540bd6f for instance 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd on hv-cinder-81888 Dec 14 10:08:42.520969 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-56bc41c3-f036-4a5c-aacd-eba8e8d8af5d req-2cec3e6c-0a2b-4ea7-8662-66d779dba150 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092093 Dec 14 10:08:42.529099 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 41/80] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:08:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:43.173030 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-7c19a709-7991-4242-b31a-b7be10deb962 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:43.174526 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-7c19a709-7991-4242-b31a-b7be10deb962 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:43.191847 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7c19a709-7991-4242-b31a-b7be10deb962 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:43.192446 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7c19a709-7991-4242-b31a-b7be10deb962 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:43.193329 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7c19a709-7991-4242-b31a-b7be10deb962 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:43.195074 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7c19a709-7991-4242-b31a-b7be10deb962 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:43.460401 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-9bcc5395-1b69-42bb-8d3e-6529c9839875 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:43.474292 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-9bcc5395-1b69-42bb-8d3e-6529c9839875 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1314 microversion: 2.1 time: 1.153557 Dec 14 10:08:43.474895 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 40/81] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:42 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1314 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:43.483919 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-dc97962d-895b-468d-b21b-b6aa1118bacd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:43.484548 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-dc97962d-895b-468d-b21b-b6aa1118bacd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:43.503994 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dc97962d-895b-468d-b21b-b6aa1118bacd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:43.504493 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dc97962d-895b-468d-b21b-b6aa1118bacd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:43.505477 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dc97962d-895b-468d-b21b-b6aa1118bacd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:43.505921 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dc97962d-895b-468d-b21b-b6aa1118bacd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:44.264945 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-7c19a709-7991-4242-b31a-b7be10deb962 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:44.282641 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-7c19a709-7991-4242-b31a-b7be10deb962 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1317 microversion: 2.1 time: 1.112849 Dec 14 10:08:44.288561 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 42/82] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:43 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1317 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:44.301686 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f93c0e07-6c61-449c-96de-8d2f046fd7c9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:44.304775 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f93c0e07-6c61-449c-96de-8d2f046fd7c9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:44.324501 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f93c0e07-6c61-449c-96de-8d2f046fd7c9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:44.325103 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f93c0e07-6c61-449c-96de-8d2f046fd7c9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:44.325913 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f93c0e07-6c61-449c-96de-8d2f046fd7c9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:44.330521 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f93c0e07-6c61-449c-96de-8d2f046fd7c9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:44.575344 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-dc97962d-895b-468d-b21b-b6aa1118bacd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:44.588169 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-dc97962d-895b-468d-b21b-b6aa1118bacd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1322 microversion: 2.1 time: 1.112179 Dec 14 10:08:44.588966 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 41/83] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:43 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1322 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:44.619908 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-f93c0e07-6c61-449c-96de-8d2f046fd7c9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:44.634153 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f93c0e07-6c61-449c-96de-8d2f046fd7c9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1296 microversion: 2.1 time: 0.345235 Dec 14 10:08:44.634972 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 43/84] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:44 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1296 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:44.639434 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-65813798-adb0-4ba2-9d11-bdffe101fee4 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:44.650869 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-65813798-adb0-4ba2-9d11-bdffe101fee4 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:44.659726 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-65813798-adb0-4ba2-9d11-bdffe101fee4 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:44.660192 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-65813798-adb0-4ba2-9d11-bdffe101fee4 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:44.660991 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-65813798-adb0-4ba2-9d11-bdffe101fee4 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:44.661435 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-65813798-adb0-4ba2-9d11-bdffe101fee4 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:44.890135 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-cda968e6-6735-4006-93f4-2a1a265278a1 req-8f722c68-7217-461c-a5d5-b7ce7ba0121c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b66506-2460-4284-aa1e-c7b2f368bb75", "name": "network-vif-plugged", "status": "completed", "tag": "3b355350-b30b-4000-9798-cdf47cd7eb43"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:44.894173 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:08:44.894173 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:08:44.906348 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-cda968e6-6735-4006-93f4-2a1a265278a1 req-8f722c68-7217-461c-a5d5-b7ce7ba0121c service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:44.907552 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-cda968e6-6735-4006-93f4-2a1a265278a1 req-8f722c68-7217-461c-a5d5-b7ce7ba0121c service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:44.932835 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-cda968e6-6735-4006-93f4-2a1a265278a1 req-8f722c68-7217-461c-a5d5-b7ce7ba0121c service nova] Creating event network-vif-plugged:3b355350-b30b-4000-9798-cdf47cd7eb43 for instance 35b66506-2460-4284-aa1e-c7b2f368bb75 on hv-cinder-81888 Dec 14 10:08:44.933609 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-cda968e6-6735-4006-93f4-2a1a265278a1 req-8f722c68-7217-461c-a5d5-b7ce7ba0121c service nova] Acquired lock "compute-rpcapi-router" {{(pid=100985) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 14 10:08:44.935237 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-48d01b11-2286-4bd0-a111-63c21d271512 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:44.935875 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-48d01b11-2286-4bd0-a111-63c21d271512 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:44.936969 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-48d01b11-2286-4bd0-a111-63c21d271512 None None] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:44.937571 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-48d01b11-2286-4bd0-a111-63c21d271512 None None] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:44.948596 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.compute.rpcapi [None req-48d01b11-2286-4bd0-a111-63c21d271512 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Dec 14 10:08:44.949686 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-48d01b11-2286-4bd0-a111-63c21d271512 None None] Releasing lock "compute-rpcapi-router" {{(pid=100985) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 14 10:08:44.976510 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-48d01b11-2286-4bd0-a111-63c21d271512 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.386050 Dec 14 10:08:44.979881 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 42/85] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:08:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:45.305297 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-34238853-0f6d-45c3-915f-0fae62a42e87 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:45.306093 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-34238853-0f6d-45c3-915f-0fae62a42e87 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:45.322286 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-34238853-0f6d-45c3-915f-0fae62a42e87 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:45.322774 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-34238853-0f6d-45c3-915f-0fae62a42e87 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:45.323562 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-34238853-0f6d-45c3-915f-0fae62a42e87 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:45.324001 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-34238853-0f6d-45c3-915f-0fae62a42e87 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:45.847510 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-65813798-adb0-4ba2-9d11-bdffe101fee4 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:45.857543 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-65813798-adb0-4ba2-9d11-bdffe101fee4 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1314 microversion: 2.1 time: 1.221405 Dec 14 10:08:45.865994 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 44/86] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:44 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1314 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:45.881113 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d19185a2-23eb-46de-b662-bbf6a2498fd8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:45.894667 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d19185a2-23eb-46de-b662-bbf6a2498fd8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:45.917783 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d19185a2-23eb-46de-b662-bbf6a2498fd8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:45.918704 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d19185a2-23eb-46de-b662-bbf6a2498fd8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:45.920530 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d19185a2-23eb-46de-b662-bbf6a2498fd8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:45.928266 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d19185a2-23eb-46de-b662-bbf6a2498fd8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:46.879457 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d19185a2-23eb-46de-b662-bbf6a2498fd8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:46.891554 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d19185a2-23eb-46de-b662-bbf6a2498fd8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1322 microversion: 2.1 time: 1.018835 Dec 14 10:08:46.894053 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 45/87] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:45 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1322 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:46.906787 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-ba362524-da51-4839-946a-22927cd4a4a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:46.907786 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-ba362524-da51-4839-946a-22927cd4a4a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:46.917855 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ba362524-da51-4839-946a-22927cd4a4a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:46.918676 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ba362524-da51-4839-946a-22927cd4a4a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:46.920094 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ba362524-da51-4839-946a-22927cd4a4a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:46.920777 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ba362524-da51-4839-946a-22927cd4a4a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:47.002738 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-34238853-0f6d-45c3-915f-0fae62a42e87 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:47.014786 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-34238853-0f6d-45c3-915f-0fae62a42e87 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1317 microversion: 2.1 time: 1.713449 Dec 14 10:08:47.016342 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 43/88] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:45 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1317 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:08:47.030303 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-9c69e738-96d7-4afb-b8cf-cf290c19f666 req-3a9d567f-7348-4a01-a224-7dc0de8fab29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b7ee709-3cab-4f17-8b02-919fd03e733d", "tag": "3937de4c-40a7-4ab1-84ef-8bcc52206b8b"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:47.034992 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:08:47.034992 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:08:47.048099 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-9c69e738-96d7-4afb-b8cf-cf290c19f666 req-3a9d567f-7348-4a01-a224-7dc0de8fab29 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:47.049335 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-9c69e738-96d7-4afb-b8cf-cf290c19f666 req-3a9d567f-7348-4a01-a224-7dc0de8fab29 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:47.086685 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-9c69e738-96d7-4afb-b8cf-cf290c19f666 req-3a9d567f-7348-4a01-a224-7dc0de8fab29 service nova] Creating event network-changed:3937de4c-40a7-4ab1-84ef-8bcc52206b8b for instance 5b7ee709-3cab-4f17-8b02-919fd03e733d on hv-cinder-81888 Dec 14 10:08:47.094849 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-9c69e738-96d7-4afb-b8cf-cf290c19f666 req-3a9d567f-7348-4a01-a224-7dc0de8fab29 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075908 Dec 14 10:08:47.097231 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 44/89] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:08:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:47.105453 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f282a9b8-586a-4697-8873-df76994e5b7c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:47.106432 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f282a9b8-586a-4697-8873-df76994e5b7c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:47.119708 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f282a9b8-586a-4697-8873-df76994e5b7c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:47.120384 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f282a9b8-586a-4697-8873-df76994e5b7c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:47.121406 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f282a9b8-586a-4697-8873-df76994e5b7c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:47.122242 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f282a9b8-586a-4697-8873-df76994e5b7c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:47.647013 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-ba362524-da51-4839-946a-22927cd4a4a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:47.666199 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-ba362524-da51-4839-946a-22927cd4a4a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1364 microversion: 2.1 time: 0.770740 Dec 14 10:08:47.666768 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 46/90] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:46 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1364 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:47.671567 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-7d423ff7-b2b5-4785-b2a9-a7669cf4ccc3 req-f16fec9f-6548-40b8-87eb-b2faf9000f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e89d5e41-df1a-438d-b051-8b9dd0104644", "name": "network-vif-plugged", "status": "completed", "tag": "b88f6614-94a6-49ff-aab2-e715637e1e86"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:47.673344 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:08:47.673344 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:08:47.695591 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-7d423ff7-b2b5-4785-b2a9-a7669cf4ccc3 req-f16fec9f-6548-40b8-87eb-b2faf9000f9f service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:47.696312 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-7d423ff7-b2b5-4785-b2a9-a7669cf4ccc3 req-f16fec9f-6548-40b8-87eb-b2faf9000f9f service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:47.731575 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-7d423ff7-b2b5-4785-b2a9-a7669cf4ccc3 req-f16fec9f-6548-40b8-87eb-b2faf9000f9f service nova] Creating event network-vif-plugged:b88f6614-94a6-49ff-aab2-e715637e1e86 for instance e89d5e41-df1a-438d-b051-8b9dd0104644 on hv-cinder-81888 Dec 14 10:08:47.742262 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-7d423ff7-b2b5-4785-b2a9-a7669cf4ccc3 req-f16fec9f-6548-40b8-87eb-b2faf9000f9f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074036 Dec 14 10:08:47.744404 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 47/91] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:08:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:47.829177 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f282a9b8-586a-4697-8873-df76994e5b7c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:47.852666 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f282a9b8-586a-4697-8873-df76994e5b7c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1314 microversion: 2.1 time: 0.751275 Dec 14 10:08:47.858008 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 45/92] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:47 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1314 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:47.910845 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c713d147-5ac9-41e3-b6af-5a8b4e9aa826 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:47.912549 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c713d147-5ac9-41e3-b6af-5a8b4e9aa826 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:47.922397 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c713d147-5ac9-41e3-b6af-5a8b4e9aa826 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:47.924546 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c713d147-5ac9-41e3-b6af-5a8b4e9aa826 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:47.925602 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c713d147-5ac9-41e3-b6af-5a8b4e9aa826 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:47.926381 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c713d147-5ac9-41e3-b6af-5a8b4e9aa826 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:48.033394 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-aadef8f7-7f4d-400a-b0e2-398473a794ac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:48.035015 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-aadef8f7-7f4d-400a-b0e2-398473a794ac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:48.046024 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-aadef8f7-7f4d-400a-b0e2-398473a794ac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:48.046834 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-aadef8f7-7f4d-400a-b0e2-398473a794ac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:48.049781 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-aadef8f7-7f4d-400a-b0e2-398473a794ac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:48.050625 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-aadef8f7-7f4d-400a-b0e2-398473a794ac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:48.828830 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c713d147-5ac9-41e3-b6af-5a8b4e9aa826 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:48.840174 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-aadef8f7-7f4d-400a-b0e2-398473a794ac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:48.847858 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c713d147-5ac9-41e3-b6af-5a8b4e9aa826 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1322 microversion: 2.1 time: 0.941717 Dec 14 10:08:48.852542 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-aadef8f7-7f4d-400a-b0e2-398473a794ac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1317 microversion: 2.1 time: 0.823848 Dec 14 10:08:48.862792 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 46/93] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:48 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1317 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:08:48.867532 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-488f5c78-94d5-494f-9cd4-24cd4d8c291b req-b86d5321-8436-4a06-a838-e10e1e835b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cb52f05-26bc-4f5b-be4f-f7ad45e4570f", "tag": "9b3dfaef-7974-48de-8abf-01274b059c49"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:48.869031 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:08:48.869031 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:08:48.873986 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 48/94] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:47 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1322 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:48.882639 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e6a8dade-6a5b-472f-b222-8d2d881953e4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:48.883233 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e6a8dade-6a5b-472f-b222-8d2d881953e4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:48.895390 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e6a8dade-6a5b-472f-b222-8d2d881953e4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:48.895837 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e6a8dade-6a5b-472f-b222-8d2d881953e4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:48.896605 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e6a8dade-6a5b-472f-b222-8d2d881953e4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:48.897036 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e6a8dade-6a5b-472f-b222-8d2d881953e4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:48.905515 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-488f5c78-94d5-494f-9cd4-24cd4d8c291b req-b86d5321-8436-4a06-a838-e10e1e835b6c service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:48.905870 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-488f5c78-94d5-494f-9cd4-24cd4d8c291b req-b86d5321-8436-4a06-a838-e10e1e835b6c service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:48.930556 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-488f5c78-94d5-494f-9cd4-24cd4d8c291b req-b86d5321-8436-4a06-a838-e10e1e835b6c service nova] Creating event network-changed:9b3dfaef-7974-48de-8abf-01274b059c49 for instance 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f on hv-cinder-81888 Dec 14 10:08:48.936038 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-488f5c78-94d5-494f-9cd4-24cd4d8c291b req-b86d5321-8436-4a06-a838-e10e1e835b6c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071930 Dec 14 10:08:48.936628 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 47/95] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:08:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:48.942470 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-cc36eb82-fca4-40ee-a9ad-8e1fc07efcf7 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:48.943369 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-cc36eb82-fca4-40ee-a9ad-8e1fc07efcf7 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:48.952162 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cc36eb82-fca4-40ee-a9ad-8e1fc07efcf7 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:48.952879 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cc36eb82-fca4-40ee-a9ad-8e1fc07efcf7 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:48.953708 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cc36eb82-fca4-40ee-a9ad-8e1fc07efcf7 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:48.954349 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cc36eb82-fca4-40ee-a9ad-8e1fc07efcf7 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:49.247967 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-cc36eb82-fca4-40ee-a9ad-8e1fc07efcf7 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:49.272627 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-cc36eb82-fca4-40ee-a9ad-8e1fc07efcf7 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1314 microversion: 2.1 time: 0.334491 Dec 14 10:08:49.286423 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 48/96] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:48 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:49.367636 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e6a8dade-6a5b-472f-b222-8d2d881953e4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:49.378444 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e6a8dade-6a5b-472f-b222-8d2d881953e4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1364 microversion: 2.1 time: 0.499521 Dec 14 10:08:49.389350 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 49/97] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:48 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1364 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:49.866271 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-35d518e8-395b-4ac4-acf2-d541d8f64ecc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:49.867195 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-35d518e8-395b-4ac4-acf2-d541d8f64ecc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:49.871721 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-78c098d5-4d51-4b9a-b59f-456645b339bf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:49.872505 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-78c098d5-4d51-4b9a-b59f-456645b339bf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:49.874725 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-35d518e8-395b-4ac4-acf2-d541d8f64ecc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:49.875300 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-35d518e8-395b-4ac4-acf2-d541d8f64ecc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:49.876247 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-35d518e8-395b-4ac4-acf2-d541d8f64ecc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:49.877230 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-35d518e8-395b-4ac4-acf2-d541d8f64ecc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:49.882251 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-78c098d5-4d51-4b9a-b59f-456645b339bf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:49.882703 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-78c098d5-4d51-4b9a-b59f-456645b339bf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:49.883725 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-78c098d5-4d51-4b9a-b59f-456645b339bf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:49.884167 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-78c098d5-4d51-4b9a-b59f-456645b339bf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:50.120694 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-78c098d5-4d51-4b9a-b59f-456645b339bf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:50.131160 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-78c098d5-4d51-4b9a-b59f-456645b339bf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1317 microversion: 2.1 time: 0.265441 Dec 14 10:08:50.132073 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 50/98] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:49 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:08:50.258803 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-35d518e8-395b-4ac4-acf2-d541d8f64ecc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:50.266783 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-35d518e8-395b-4ac4-acf2-d541d8f64ecc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1322 microversion: 2.1 time: 0.406103 Dec 14 10:08:50.267932 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 49/99] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:49 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1322 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:50.291026 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f219324d-a8ce-4bdb-8489-686b3ee9fbca tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:50.293094 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f219324d-a8ce-4bdb-8489-686b3ee9fbca tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:50.314147 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f219324d-a8ce-4bdb-8489-686b3ee9fbca tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:50.314769 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f219324d-a8ce-4bdb-8489-686b3ee9fbca tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:50.315811 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f219324d-a8ce-4bdb-8489-686b3ee9fbca tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:50.316381 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f219324d-a8ce-4bdb-8489-686b3ee9fbca tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:50.396453 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c8ee75f5-0e53-4d1c-b81c-a4a94c86e790 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:50.397101 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c8ee75f5-0e53-4d1c-b81c-a4a94c86e790 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:50.410199 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c8ee75f5-0e53-4d1c-b81c-a4a94c86e790 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:50.410199 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c8ee75f5-0e53-4d1c-b81c-a4a94c86e790 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:50.412284 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c8ee75f5-0e53-4d1c-b81c-a4a94c86e790 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:50.412645 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c8ee75f5-0e53-4d1c-b81c-a4a94c86e790 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:50.639814 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-f219324d-a8ce-4bdb-8489-686b3ee9fbca tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:50.646379 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f219324d-a8ce-4bdb-8489-686b3ee9fbca tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1314 microversion: 2.1 time: 0.360212 Dec 14 10:08:50.646956 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 51/100] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:50 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:08:50.754919 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-c8ee75f5-0e53-4d1c-b81c-a4a94c86e790 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:50.763317 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c8ee75f5-0e53-4d1c-b81c-a4a94c86e790 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1364 microversion: 2.1 time: 0.371285 Dec 14 10:08:50.763974 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 50/101] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:50 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1364 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:51.147656 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-0cd71a92-616a-4c20-a334-0c94f1b5001a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:51.148506 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-0cd71a92-616a-4c20-a334-0c94f1b5001a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:51.156706 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0cd71a92-616a-4c20-a334-0c94f1b5001a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:51.157346 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0cd71a92-616a-4c20-a334-0c94f1b5001a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:51.158673 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0cd71a92-616a-4c20-a334-0c94f1b5001a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:51.159355 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0cd71a92-616a-4c20-a334-0c94f1b5001a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:51.285288 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f3508cce-0556-45d6-8549-cc9c7ffe4f2e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:51.287064 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f3508cce-0556-45d6-8549-cc9c7ffe4f2e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:51.295008 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f3508cce-0556-45d6-8549-cc9c7ffe4f2e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:51.295705 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f3508cce-0556-45d6-8549-cc9c7ffe4f2e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:51.296883 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f3508cce-0556-45d6-8549-cc9c7ffe4f2e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:51.297502 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f3508cce-0556-45d6-8549-cc9c7ffe4f2e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:51.380468 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-0cd71a92-616a-4c20-a334-0c94f1b5001a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:51.398028 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-0cd71a92-616a-4c20-a334-0c94f1b5001a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1317 microversion: 2.1 time: 0.253860 Dec 14 10:08:51.398607 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 52/102] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:51 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:51.528543 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f3508cce-0556-45d6-8549-cc9c7ffe4f2e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:51.537235 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f3508cce-0556-45d6-8549-cc9c7ffe4f2e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1322 microversion: 2.1 time: 0.256211 Dec 14 10:08:51.537732 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 51/103] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:51 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:51.663827 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-36817001-8275-412d-a36c-a86b78151549 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:51.664405 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-36817001-8275-412d-a36c-a86b78151549 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:51.679508 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-36817001-8275-412d-a36c-a86b78151549 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:51.679965 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-36817001-8275-412d-a36c-a86b78151549 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:51.680743 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-36817001-8275-412d-a36c-a86b78151549 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:51.681178 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-36817001-8275-412d-a36c-a86b78151549 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:51.781055 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-276cfa9f-7227-4fc2-8f56-9ef1a63f1841 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:51.781920 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-276cfa9f-7227-4fc2-8f56-9ef1a63f1841 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:51.802050 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-276cfa9f-7227-4fc2-8f56-9ef1a63f1841 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:51.802757 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-276cfa9f-7227-4fc2-8f56-9ef1a63f1841 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:51.803769 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-276cfa9f-7227-4fc2-8f56-9ef1a63f1841 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:51.806715 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-276cfa9f-7227-4fc2-8f56-9ef1a63f1841 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:52.446215 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-36817001-8275-412d-a36c-a86b78151549 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:52.462331 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-36817001-8275-412d-a36c-a86b78151549 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1314 microversion: 2.1 time: 0.799907 Dec 14 10:08:52.463640 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 53/104] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:51 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1314 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:52.472238 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-ad615967-6fb7-4c48-8c33-62707fb6ccac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:52.473117 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-ad615967-6fb7-4c48-8c33-62707fb6ccac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:52.497310 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-276cfa9f-7227-4fc2-8f56-9ef1a63f1841 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:52.499010 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ad615967-6fb7-4c48-8c33-62707fb6ccac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:52.500276 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ad615967-6fb7-4c48-8c33-62707fb6ccac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:52.505367 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ad615967-6fb7-4c48-8c33-62707fb6ccac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:52.506282 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ad615967-6fb7-4c48-8c33-62707fb6ccac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:52.507773 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-276cfa9f-7227-4fc2-8f56-9ef1a63f1841 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1364 microversion: 2.1 time: 0.730558 Dec 14 10:08:52.510945 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 52/105] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:51 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1364 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:08:52.554746 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-bd528f37-d0c5-4ca0-bd65-fa7e8d0175a3 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:52.555521 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-bd528f37-d0c5-4ca0-bd65-fa7e8d0175a3 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:52.582310 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bd528f37-d0c5-4ca0-bd65-fa7e8d0175a3 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:52.582310 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bd528f37-d0c5-4ca0-bd65-fa7e8d0175a3 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:52.582310 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bd528f37-d0c5-4ca0-bd65-fa7e8d0175a3 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:52.582310 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bd528f37-d0c5-4ca0-bd65-fa7e8d0175a3 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:53.117545 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-bd528f37-d0c5-4ca0-bd65-fa7e8d0175a3 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:53.127072 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-ad615967-6fb7-4c48-8c33-62707fb6ccac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:53.131432 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-bd528f37-d0c5-4ca0-bd65-fa7e8d0175a3 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1322 microversion: 2.1 time: 0.580974 Dec 14 10:08:53.132678 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 53/106] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:52 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1322 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:08:53.152461 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-ad615967-6fb7-4c48-8c33-62707fb6ccac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1506 microversion: 2.1 time: 0.684415 Dec 14 10:08:53.153551 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 54/107] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:52 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1506 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:53.480498 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-dfc8e629-c400-4c16-bb85-4e5d51f1d618 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:53.481155 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-dfc8e629-c400-4c16-bb85-4e5d51f1d618 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:53.492843 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dfc8e629-c400-4c16-bb85-4e5d51f1d618 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:53.493294 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dfc8e629-c400-4c16-bb85-4e5d51f1d618 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:53.494112 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dfc8e629-c400-4c16-bb85-4e5d51f1d618 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:53.497285 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dfc8e629-c400-4c16-bb85-4e5d51f1d618 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:53.528122 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-9473f813-0b4d-4034-890e-5d16958c496c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:53.529087 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-9473f813-0b4d-4034-890e-5d16958c496c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:53.541619 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9473f813-0b4d-4034-890e-5d16958c496c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:53.543829 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9473f813-0b4d-4034-890e-5d16958c496c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:53.545857 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9473f813-0b4d-4034-890e-5d16958c496c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:53.547684 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9473f813-0b4d-4034-890e-5d16958c496c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:53.935712 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-9473f813-0b4d-4034-890e-5d16958c496c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:53.949690 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-9473f813-0b4d-4034-890e-5d16958c496c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1364 microversion: 2.1 time: 0.425874 Dec 14 10:08:53.964828 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 55/108] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:53 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1364 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:08:54.048636 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-fe042d65-4011-4876-8164-2bc281b270eb req-3e07c409-7716-4902-9ddc-7ace7a622d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b4bf45-d284-4fcf-acc0-610f2a7b7dcd", "name": "network-vif-plugged", "status": "completed", "tag": "7a526190-4919-4594-99c3-7109b540bd6f"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:54.050312 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:08:54.050312 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:08:54.065426 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-fe042d65-4011-4876-8164-2bc281b270eb req-3e07c409-7716-4902-9ddc-7ace7a622d6a service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:54.065696 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-fe042d65-4011-4876-8164-2bc281b270eb req-3e07c409-7716-4902-9ddc-7ace7a622d6a service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:54.111158 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-fe042d65-4011-4876-8164-2bc281b270eb req-3e07c409-7716-4902-9ddc-7ace7a622d6a service nova] Creating event network-vif-plugged:7a526190-4919-4594-99c3-7109b540bd6f for instance 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd on hv-cinder-81888 Dec 14 10:08:54.123515 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-fe042d65-4011-4876-8164-2bc281b270eb req-3e07c409-7716-4902-9ddc-7ace7a622d6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078688 Dec 14 10:08:54.128497 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 56/109] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:08:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:08:54.155699 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-dfaf0f4e-070d-4f7f-a2ae-cc4743700295 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:54.156775 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-dfaf0f4e-070d-4f7f-a2ae-cc4743700295 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:54.180550 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dfaf0f4e-070d-4f7f-a2ae-cc4743700295 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:54.181237 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dfaf0f4e-070d-4f7f-a2ae-cc4743700295 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:54.182291 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dfaf0f4e-070d-4f7f-a2ae-cc4743700295 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:54.182912 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dfaf0f4e-070d-4f7f-a2ae-cc4743700295 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:54.408912 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-dfc8e629-c400-4c16-bb85-4e5d51f1d618 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:54.422668 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-dfc8e629-c400-4c16-bb85-4e5d51f1d618 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1502 microversion: 2.1 time: 0.943267 Dec 14 10:08:54.424210 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 54/110] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:53 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1502 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:54.480977 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-2bdcec00-0eff-4720-b1ca-17ef387c935d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d71a5bc6-ab84-4686-9adb-7196ada466ad"}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:54.482201 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-2bdcec00-0eff-4720-b1ca-17ef387c935d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:54.492124 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2bdcec00-0eff-4720-b1ca-17ef387c935d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:54.492864 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2bdcec00-0eff-4720-b1ca-17ef387c935d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:54.493933 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2bdcec00-0eff-4720-b1ca-17ef387c935d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:54.494563 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2bdcec00-0eff-4720-b1ca-17ef387c935d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:54.514302 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-dfaf0f4e-070d-4f7f-a2ae-cc4743700295 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:54.528231 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-dfaf0f4e-070d-4f7f-a2ae-cc4743700295 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1322 microversion: 2.1 time: 0.382447 Dec 14 10:08:54.540466 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 57/111] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:54 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:08:54.968420 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-87f6c4b0-bed8-436a-a93d-060ea6a5eb7e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:54.969023 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-87f6c4b0-bed8-436a-a93d-060ea6a5eb7e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:54.995523 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-87f6c4b0-bed8-436a-a93d-060ea6a5eb7e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:54.996031 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-87f6c4b0-bed8-436a-a93d-060ea6a5eb7e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:54.997030 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-87f6c4b0-bed8-436a-a93d-060ea6a5eb7e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:54.997560 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-87f6c4b0-bed8-436a-a93d-060ea6a5eb7e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:55.239393 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-87f6c4b0-bed8-436a-a93d-060ea6a5eb7e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:55.247460 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-87f6c4b0-bed8-436a-a93d-060ea6a5eb7e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1364 microversion: 2.1 time: 0.283023 Dec 14 10:08:55.248031 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 58/112] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:54 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1364 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:08:55.493029 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4aa29686-1890-451c-ac0a-47094ce1a20c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb2bf88c-048b-4312-8988-54389fd813a7"}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:55.494154 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4aa29686-1890-451c-ac0a-47094ce1a20c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:55.502822 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4aa29686-1890-451c-ac0a-47094ce1a20c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:55.503277 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4aa29686-1890-451c-ac0a-47094ce1a20c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:55.504042 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4aa29686-1890-451c-ac0a-47094ce1a20c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:55.504475 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4aa29686-1890-451c-ac0a-47094ce1a20c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:55.663707 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-2bdcec00-0eff-4720-b1ca-17ef387c935d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "POST /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.186644 Dec 14 10:08:55.670472 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 55/113] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Dec 14 10:08:54 2021] POST /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75/os-volume_attachments => generated 194 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:55.678057 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c13b0db8-9b7a-48e1-a7a9-c27e74c2af82 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:55.699744 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c13b0db8-9b7a-48e1-a7a9-c27e74c2af82 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:55.710340 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c13b0db8-9b7a-48e1-a7a9-c27e74c2af82 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:55.714058 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c13b0db8-9b7a-48e1-a7a9-c27e74c2af82 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:55.714883 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c13b0db8-9b7a-48e1-a7a9-c27e74c2af82 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:55.715329 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c13b0db8-9b7a-48e1-a7a9-c27e74c2af82 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:56.063947 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-c13b0db8-9b7a-48e1-a7a9-c27e74c2af82 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:56.074615 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c13b0db8-9b7a-48e1-a7a9-c27e74c2af82 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1322 microversion: 2.1 time: 0.401875 Dec 14 10:08:56.075298 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 56/114] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:55 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:56.189898 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-f40bdad7-d421-4025-94ad-4be188a70f38 req-e3a054f1-27c9-4087-b19b-180963cafcdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b7ee709-3cab-4f17-8b02-919fd03e733d", "name": "network-vif-plugged", "status": "completed", "tag": "3937de4c-40a7-4ab1-84ef-8bcc52206b8b"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:56.191881 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:08:56.191881 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:08:56.200758 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-f40bdad7-d421-4025-94ad-4be188a70f38 req-e3a054f1-27c9-4087-b19b-180963cafcdd service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:56.201187 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-f40bdad7-d421-4025-94ad-4be188a70f38 req-e3a054f1-27c9-4087-b19b-180963cafcdd service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:56.231494 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-f40bdad7-d421-4025-94ad-4be188a70f38 req-e3a054f1-27c9-4087-b19b-180963cafcdd service nova] Creating event network-vif-plugged:3937de4c-40a7-4ab1-84ef-8bcc52206b8b for instance 5b7ee709-3cab-4f17-8b02-919fd03e733d on hv-cinder-81888 Dec 14 10:08:56.245646 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-f40bdad7-d421-4025-94ad-4be188a70f38 req-e3a054f1-27c9-4087-b19b-180963cafcdd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057618 Dec 14 10:08:56.250544 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 57/115] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:08:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:08:56.265880 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-89eff928-f02e-4a18-b41c-2bf6b75c3fda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:56.266687 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-89eff928-f02e-4a18-b41c-2bf6b75c3fda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:56.276396 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-89eff928-f02e-4a18-b41c-2bf6b75c3fda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:56.276967 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-89eff928-f02e-4a18-b41c-2bf6b75c3fda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:56.277883 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-89eff928-f02e-4a18-b41c-2bf6b75c3fda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:56.278459 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-89eff928-f02e-4a18-b41c-2bf6b75c3fda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:56.697038 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-89eff928-f02e-4a18-b41c-2bf6b75c3fda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:56.707622 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-89eff928-f02e-4a18-b41c-2bf6b75c3fda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1364 microversion: 2.1 time: 0.446878 Dec 14 10:08:56.708198 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 58/116] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:56 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1364 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:08:56.975170 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4aa29686-1890-451c-ac0a-47094ce1a20c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "POST /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.491150 Dec 14 10:08:56.976828 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 59/117] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Dec 14 10:08:55 2021] POST /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644/os-volume_attachments => generated 194 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:57.092175 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-d3e01443-a6e2-485e-96ca-ed3394b4dc15 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:57.093137 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-d3e01443-a6e2-485e-96ca-ed3394b4dc15 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:57.101141 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d3e01443-a6e2-485e-96ca-ed3394b4dc15 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:57.101783 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d3e01443-a6e2-485e-96ca-ed3394b4dc15 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:57.102725 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d3e01443-a6e2-485e-96ca-ed3394b4dc15 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:57.103365 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d3e01443-a6e2-485e-96ca-ed3394b4dc15 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:57.375277 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-d3e01443-a6e2-485e-96ca-ed3394b4dc15 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:57.385044 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-d3e01443-a6e2-485e-96ca-ed3394b4dc15 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1322 microversion: 2.1 time: 0.295862 Dec 14 10:08:57.397555 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 59/118] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:57 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:57.726502 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c83b038f-4831-48b7-ad59-b96d67d8e584 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:57.727530 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c83b038f-4831-48b7-ad59-b96d67d8e584 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:57.736828 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c83b038f-4831-48b7-ad59-b96d67d8e584 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:57.737253 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c83b038f-4831-48b7-ad59-b96d67d8e584 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:57.741786 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c83b038f-4831-48b7-ad59-b96d67d8e584 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:57.743301 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c83b038f-4831-48b7-ad59-b96d67d8e584 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:57.976845 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c83b038f-4831-48b7-ad59-b96d67d8e584 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:57.988038 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c83b038f-4831-48b7-ad59-b96d67d8e584 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1364 microversion: 2.1 time: 0.265832 Dec 14 10:08:57.989322 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 60/119] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:57 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:58.266578 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-b7e90b10-7196-4710-a18c-73a8e7f8d0bf req-c1b8ed54-a563-44fb-a8b7-d5f7ee0b3799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cb52f05-26bc-4f5b-be4f-f7ad45e4570f", "name": "network-vif-plugged", "status": "completed", "tag": "9b3dfaef-7974-48de-8abf-01274b059c49"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:58.268343 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:08:58.268343 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:08:58.277771 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-b7e90b10-7196-4710-a18c-73a8e7f8d0bf req-c1b8ed54-a563-44fb-a8b7-d5f7ee0b3799 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:58.278575 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-b7e90b10-7196-4710-a18c-73a8e7f8d0bf req-c1b8ed54-a563-44fb-a8b7-d5f7ee0b3799 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:58.296267 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-b7e90b10-7196-4710-a18c-73a8e7f8d0bf req-c1b8ed54-a563-44fb-a8b7-d5f7ee0b3799 service nova] Creating event network-vif-plugged:9b3dfaef-7974-48de-8abf-01274b059c49 for instance 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f on hv-cinder-81888 Dec 14 10:08:58.302000 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-b7e90b10-7196-4710-a18c-73a8e7f8d0bf req-c1b8ed54-a563-44fb-a8b7-d5f7ee0b3799 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038929 Dec 14 10:08:58.302862 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 60/120] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:08:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:08:58.405648 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-32e5fa8f-2c78-4b18-bf28-33f3fe1c5b63 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:58.406286 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-32e5fa8f-2c78-4b18-bf28-33f3fe1c5b63 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:58.415169 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-32e5fa8f-2c78-4b18-bf28-33f3fe1c5b63 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:58.415902 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-32e5fa8f-2c78-4b18-bf28-33f3fe1c5b63 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:58.416866 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-32e5fa8f-2c78-4b18-bf28-33f3fe1c5b63 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:58.417737 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-32e5fa8f-2c78-4b18-bf28-33f3fe1c5b63 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:58.665704 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-32e5fa8f-2c78-4b18-bf28-33f3fe1c5b63 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:58.675262 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-32e5fa8f-2c78-4b18-bf28-33f3fe1c5b63 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1515 microversion: 2.1 time: 0.274319 Dec 14 10:08:58.686042 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 61/121] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:58 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1515 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:58.693770 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-34bea4c8-7838-460d-8570-c809aa3c79dc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:08:58.696024 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-34bea4c8-7838-460d-8570-c809aa3c79dc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:58.703464 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-34bea4c8-7838-460d-8570-c809aa3c79dc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:58.703910 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-34bea4c8-7838-460d-8570-c809aa3c79dc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:58.704721 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-34bea4c8-7838-460d-8570-c809aa3c79dc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:58.705150 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-34bea4c8-7838-460d-8570-c809aa3c79dc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:58.764725 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.objects.instance [None req-34bea4c8-7838-460d-8570-c809aa3c79dc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lazy-loading 'flavor' on Instance uuid 5b7ee709-3cab-4f17-8b02-919fd03e733d {{(pid=100985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:08:58.917188 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-34bea4c8-7838-460d-8570-c809aa3c79dc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "POST /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d/action" status: 200 len: 32 microversion: 2.1 time: 0.227723 Dec 14 10:08:58.921450 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 61/122] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:08:58 2021] POST /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d/action => generated 32 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 14 10:08:58.927065 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-82a937ec-0340-4669-a6a0-2177ab1801ae tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:58.927671 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-82a937ec-0340-4669-a6a0-2177ab1801ae tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:58.935269 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-82a937ec-0340-4669-a6a0-2177ab1801ae tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:58.935895 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-82a937ec-0340-4669-a6a0-2177ab1801ae tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:58.936672 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-82a937ec-0340-4669-a6a0-2177ab1801ae tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:58.937274 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-82a937ec-0340-4669-a6a0-2177ab1801ae tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:59.006414 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-12e6308a-9d3b-4304-8ac1-a61050f873cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:08:59.007449 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-12e6308a-9d3b-4304-8ac1-a61050f873cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:08:59.021929 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-12e6308a-9d3b-4304-8ac1-a61050f873cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:59.023952 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-12e6308a-9d3b-4304-8ac1-a61050f873cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:59.030088 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-12e6308a-9d3b-4304-8ac1-a61050f873cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:08:59.030849 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-12e6308a-9d3b-4304-8ac1-a61050f873cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:08:59.165386 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-82a937ec-0340-4669-a6a0-2177ab1801ae tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:59.176070 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-82a937ec-0340-4669-a6a0-2177ab1801ae tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.253206 Dec 14 10:08:59.176789 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 62/123] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:58 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:08:59.296346 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-12e6308a-9d3b-4304-8ac1-a61050f873cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:08:59.305918 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-12e6308a-9d3b-4304-8ac1-a61050f873cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1364 microversion: 2.1 time: 0.304389 Dec 14 10:08:59.306891 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 62/124] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:08:58 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1364 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:00.193485 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-7457e7b3-bf71-4e4f-9216-ba32399bba14 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:00.194137 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-7457e7b3-bf71-4e4f-9216-ba32399bba14 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:00.201317 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7457e7b3-bf71-4e4f-9216-ba32399bba14 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:00.201755 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7457e7b3-bf71-4e4f-9216-ba32399bba14 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:00.202561 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7457e7b3-bf71-4e4f-9216-ba32399bba14 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:00.202991 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7457e7b3-bf71-4e4f-9216-ba32399bba14 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:00.323036 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-bb00de3c-7e73-440e-bce2-aa6eb6b97896 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:00.323858 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-bb00de3c-7e73-440e-bce2-aa6eb6b97896 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:00.333630 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bb00de3c-7e73-440e-bce2-aa6eb6b97896 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:00.334356 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bb00de3c-7e73-440e-bce2-aa6eb6b97896 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:00.335435 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bb00de3c-7e73-440e-bce2-aa6eb6b97896 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:00.337583 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bb00de3c-7e73-440e-bce2-aa6eb6b97896 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:00.432807 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-7457e7b3-bf71-4e4f-9216-ba32399bba14 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:00.444010 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-7457e7b3-bf71-4e4f-9216-ba32399bba14 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.254779 Dec 14 10:09:00.445247 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 63/125] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:00 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:00.569548 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-bb00de3c-7e73-440e-bce2-aa6eb6b97896 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:00.577949 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-bb00de3c-7e73-440e-bce2-aa6eb6b97896 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1364 microversion: 2.1 time: 0.258559 Dec 14 10:09:00.578531 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 63/126] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:00 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:01.461512 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-b62eb386-af17-492a-9c9f-af335ffd92ea tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:01.462280 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-b62eb386-af17-492a-9c9f-af335ffd92ea tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:01.469776 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b62eb386-af17-492a-9c9f-af335ffd92ea tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:01.470903 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b62eb386-af17-492a-9c9f-af335ffd92ea tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:01.471762 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b62eb386-af17-492a-9c9f-af335ffd92ea tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:01.472282 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b62eb386-af17-492a-9c9f-af335ffd92ea tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:01.595064 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-d771029d-cf32-4c45-ad67-e2007e21fa9e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:01.595669 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-d771029d-cf32-4c45-ad67-e2007e21fa9e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:01.603016 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d771029d-cf32-4c45-ad67-e2007e21fa9e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:01.603494 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d771029d-cf32-4c45-ad67-e2007e21fa9e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:01.604265 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d771029d-cf32-4c45-ad67-e2007e21fa9e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:01.604797 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d771029d-cf32-4c45-ad67-e2007e21fa9e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:01.818649 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-d771029d-cf32-4c45-ad67-e2007e21fa9e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:01.833281 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-d771029d-cf32-4c45-ad67-e2007e21fa9e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1364 microversion: 2.1 time: 0.241739 Dec 14 10:09:01.834814 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 64/127] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:01 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:01.992859 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-b62eb386-af17-492a-9c9f-af335ffd92ea tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:02.005360 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-b62eb386-af17-492a-9c9f-af335ffd92ea tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.547443 Dec 14 10:09:02.006298 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 64/128] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:01 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:02.851272 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6b89db38-cb06-4a39-997d-49b5cef3a934 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:02.852157 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6b89db38-cb06-4a39-997d-49b5cef3a934 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:02.861418 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6b89db38-cb06-4a39-997d-49b5cef3a934 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:02.862575 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6b89db38-cb06-4a39-997d-49b5cef3a934 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:02.863523 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6b89db38-cb06-4a39-997d-49b5cef3a934 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:02.864169 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6b89db38-cb06-4a39-997d-49b5cef3a934 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:03.025777 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1e669cbc-ad20-4a3c-8844-66edf5f37256 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:03.027072 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1e669cbc-ad20-4a3c-8844-66edf5f37256 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:03.045070 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1e669cbc-ad20-4a3c-8844-66edf5f37256 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:03.047883 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1e669cbc-ad20-4a3c-8844-66edf5f37256 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:03.050462 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1e669cbc-ad20-4a3c-8844-66edf5f37256 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:03.052475 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1e669cbc-ad20-4a3c-8844-66edf5f37256 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:03.199448 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-6b89db38-cb06-4a39-997d-49b5cef3a934 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:03.217845 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6b89db38-cb06-4a39-997d-49b5cef3a934 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1364 microversion: 2.1 time: 0.370487 Dec 14 10:09:03.223257 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 65/129] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:02 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1364 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:03.426547 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1e669cbc-ad20-4a3c-8844-66edf5f37256 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:03.437759 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1e669cbc-ad20-4a3c-8844-66edf5f37256 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.415854 Dec 14 10:09:03.438521 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 65/130] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:03 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:04.240239 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-95af8238-1c4d-4df7-bd8b-69994353f5c9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:04.241685 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-95af8238-1c4d-4df7-bd8b-69994353f5c9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:04.253684 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-95af8238-1c4d-4df7-bd8b-69994353f5c9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:04.254167 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-95af8238-1c4d-4df7-bd8b-69994353f5c9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:04.255118 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-95af8238-1c4d-4df7-bd8b-69994353f5c9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:04.255797 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-95af8238-1c4d-4df7-bd8b-69994353f5c9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:04.456409 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-de8b9205-5967-4308-a6b3-bdf5f2ec2850 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:04.457598 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-de8b9205-5967-4308-a6b3-bdf5f2ec2850 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:04.465732 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-de8b9205-5967-4308-a6b3-bdf5f2ec2850 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:04.466619 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-de8b9205-5967-4308-a6b3-bdf5f2ec2850 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:04.467832 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-de8b9205-5967-4308-a6b3-bdf5f2ec2850 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:04.468437 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-de8b9205-5967-4308-a6b3-bdf5f2ec2850 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:04.626458 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-95af8238-1c4d-4df7-bd8b-69994353f5c9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:04.643533 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-95af8238-1c4d-4df7-bd8b-69994353f5c9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1550 microversion: 2.1 time: 0.406875 Dec 14 10:09:04.655538 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 66/131] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:04 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1550 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:04.663037 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-174c7e49-b131-41c5-91d0-05722c9e2874 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:04.663813 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-174c7e49-b131-41c5-91d0-05722c9e2874 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:04.673685 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-174c7e49-b131-41c5-91d0-05722c9e2874 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:04.675165 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-174c7e49-b131-41c5-91d0-05722c9e2874 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:04.676140 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-174c7e49-b131-41c5-91d0-05722c9e2874 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:04.676726 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-174c7e49-b131-41c5-91d0-05722c9e2874 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:04.728976 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-de8b9205-5967-4308-a6b3-bdf5f2ec2850 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:04.738918 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-de8b9205-5967-4308-a6b3-bdf5f2ec2850 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.287737 Dec 14 10:09:04.739795 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 66/132] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:04 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:04.852991 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-174c7e49-b131-41c5-91d0-05722c9e2874 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.195394 Dec 14 10:09:04.853835 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 67/133] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Dec 14 10:09:04 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/os-interface => generated 285 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:09:05.542292 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-678c7b20-75d4-465b-a584-0c0d85d15964 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-765136027", "imageRef": "5be36fdc-2baa-4efd-b830-5a5c3fd7beba", "flavorRef": "452", "networks": [{"uuid": "fcd0582b-f091-4bb6-bfce-2519464100b0"}]}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:05.644196 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.network.neutron [None req-678c7b20-75d4-465b-a584-0c0d85d15964 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] validate_networks() for [('fcd0582b-f091-4bb6-bfce-2519464100b0', None, None, None)] {{(pid=100984) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:09:05.757271 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-661ca769-fedc-4303-a97f-8407a3cfb419 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:05.758279 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-661ca769-fedc-4303-a97f-8407a3cfb419 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:05.775622 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-661ca769-fedc-4303-a97f-8407a3cfb419 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:05.777441 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-661ca769-fedc-4303-a97f-8407a3cfb419 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:05.779880 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-661ca769-fedc-4303-a97f-8407a3cfb419 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:05.782191 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-661ca769-fedc-4303-a97f-8407a3cfb419 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:06.316192 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-661ca769-fedc-4303-a97f-8407a3cfb419 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:06.325846 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-661ca769-fedc-4303-a97f-8407a3cfb419 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.572162 Dec 14 10:09:06.326475 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 68/134] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:05 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:06.464106 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-678c7b20-75d4-465b-a584-0c0d85d15964 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Flavor limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:09:06.464726 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-678c7b20-75d4-465b-a584-0c0d85d15964 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Image limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:09:06.465855 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-678c7b20-75d4-465b-a584-0c0d85d15964 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Flavor pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:09:06.470883 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-678c7b20-75d4-465b-a584-0c0d85d15964 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Image pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:09:06.471651 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-678c7b20-75d4-465b-a584-0c0d85d15964 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:09:06.481465 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-678c7b20-75d4-465b-a584-0c0d85d15964 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:06.482317 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-678c7b20-75d4-465b-a584-0c0d85d15964 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:06.482880 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-678c7b20-75d4-465b-a584-0c0d85d15964 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:06.483330 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-678c7b20-75d4-465b-a584-0c0d85d15964 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:06.507508 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-678c7b20-75d4-465b-a584-0c0d85d15964 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Getting quotas for project 55d21e35946242e9b067686ed5f812ac. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:09:06.516700 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-678c7b20-75d4-465b-a584-0c0d85d15964 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Getting quotas for user 61ac29796a444ae88d119870a479baa9 and project 55d21e35946242e9b067686ed5f812ac. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:09:06.533738 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-678c7b20-75d4-465b-a584-0c0d85d15964 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Going to run 1 instances... {{(pid=100984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:09:06.536246 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-678c7b20-75d4-465b-a584-0c0d85d15964 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5be36fdc-2baa-4efd-b830-5a5c3fd7beba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:09:06.596779 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-678c7b20-75d4-465b-a584-0c0d85d15964 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.059343 Dec 14 10:09:06.598003 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 67/135] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Dec 14 10:09:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 10:09:06.608456 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-275f3b4d-4641-4ae9-b6f8-93395c85771c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:06.609495 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-275f3b4d-4641-4ae9-b6f8-93395c85771c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:06.775981 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-275f3b4d-4641-4ae9-b6f8-93395c85771c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:06.784647 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-275f3b4d-4641-4ae9-b6f8-93395c85771c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e" status: 200 len: 1217 microversion: 2.1 time: 0.179782 Dec 14 10:09:06.785438 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 69/136] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:06 2021] GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e => generated 1217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:07.344081 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4b1564c0-0c97-4864-be55-9a699c372e6d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:07.344738 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4b1564c0-0c97-4864-be55-9a699c372e6d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:07.357993 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4b1564c0-0c97-4864-be55-9a699c372e6d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:07.358696 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4b1564c0-0c97-4864-be55-9a699c372e6d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:07.359624 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4b1564c0-0c97-4864-be55-9a699c372e6d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:07.360207 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4b1564c0-0c97-4864-be55-9a699c372e6d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:07.365841 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-bba44ab2-1f9e-476f-bc9d-fa6462c59927 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:07.385805 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-bba44ab2-1f9e-476f-bc9d-fa6462c59927 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:07.403829 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bba44ab2-1f9e-476f-bc9d-fa6462c59927 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:07.404586 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bba44ab2-1f9e-476f-bc9d-fa6462c59927 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:07.406290 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bba44ab2-1f9e-476f-bc9d-fa6462c59927 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:07.407162 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bba44ab2-1f9e-476f-bc9d-fa6462c59927 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:07.598018 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-bba44ab2-1f9e-476f-bc9d-fa6462c59927 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 14 microversion: 2.1 time: 0.247028 Dec 14 10:09:07.599436 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 70/137] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:07 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 14 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 10:09:07.608370 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-c8129ec3-9d7e-4bd6-94ba-c2f101d06cc2 req-4fb86722-eee7-4a36-9650-f0ecda8eccba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cb52f05-26bc-4f5b-be4f-f7ad45e4570f", "tag": "9b3dfaef-7974-48de-8abf-01274b059c49"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:07.611329 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:09:07.611329 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:09:07.627642 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-c8129ec3-9d7e-4bd6-94ba-c2f101d06cc2 req-4fb86722-eee7-4a36-9650-f0ecda8eccba service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:07.628378 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-c8129ec3-9d7e-4bd6-94ba-c2f101d06cc2 req-4fb86722-eee7-4a36-9650-f0ecda8eccba service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:07.658389 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-c8129ec3-9d7e-4bd6-94ba-c2f101d06cc2 req-4fb86722-eee7-4a36-9650-f0ecda8eccba service nova] Creating event network-changed:9b3dfaef-7974-48de-8abf-01274b059c49 for instance 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f on hv-cinder-81888 Dec 14 10:09:07.666007 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-c8129ec3-9d7e-4bd6-94ba-c2f101d06cc2 req-4fb86722-eee7-4a36-9650-f0ecda8eccba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062591 Dec 14 10:09:07.666988 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 71/138] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:09:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:09:07.804864 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-11fe4450-1adf-4011-8814-7c5f8c055cea tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:07.806371 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-11fe4450-1adf-4011-8814-7c5f8c055cea tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:07.819039 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-11fe4450-1adf-4011-8814-7c5f8c055cea tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:07.831859 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-11fe4450-1adf-4011-8814-7c5f8c055cea tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:07.835166 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-11fe4450-1adf-4011-8814-7c5f8c055cea tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:07.835779 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-11fe4450-1adf-4011-8814-7c5f8c055cea tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:07.887772 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4b1564c0-0c97-4864-be55-9a699c372e6d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:07.919663 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4b1564c0-0c97-4864-be55-9a699c372e6d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.564486 Dec 14 10:09:07.919663 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 68/139] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:07 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:08.205978 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-11fe4450-1adf-4011-8814-7c5f8c055cea tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:08.216587 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-11fe4450-1adf-4011-8814-7c5f8c055cea tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e" status: 200 len: 1269 microversion: 2.1 time: 0.416485 Dec 14 10:09:08.217174 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 72/140] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:07 2021] GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e => generated 1269 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:08.609014 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1b666e91-2554-4009-9c46-1e3e0ea80203 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:08.616981 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1b666e91-2554-4009-9c46-1e3e0ea80203 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:08.635110 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1b666e91-2554-4009-9c46-1e3e0ea80203 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:08.635718 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1b666e91-2554-4009-9c46-1e3e0ea80203 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:08.637945 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1b666e91-2554-4009-9c46-1e3e0ea80203 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:08.638562 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1b666e91-2554-4009-9c46-1e3e0ea80203 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:08.801275 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1b666e91-2554-4009-9c46-1e3e0ea80203 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 14 microversion: 2.1 time: 0.195947 Dec 14 10:09:08.802440 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 69/141] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:08 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 14 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 10:09:08.932915 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b1aa5fe2-0e3d-443d-8e84-08e129775e7d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:08.935536 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-b1aa5fe2-0e3d-443d-8e84-08e129775e7d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:08.945236 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b1aa5fe2-0e3d-443d-8e84-08e129775e7d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:08.946753 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b1aa5fe2-0e3d-443d-8e84-08e129775e7d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:08.949746 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b1aa5fe2-0e3d-443d-8e84-08e129775e7d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:08.952292 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b1aa5fe2-0e3d-443d-8e84-08e129775e7d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:09.242183 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-98000d7f-f9d9-4664-bc03-7b02a4d9fa5f tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:09.243514 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-98000d7f-f9d9-4664-bc03-7b02a4d9fa5f tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:09.266254 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-98000d7f-f9d9-4664-bc03-7b02a4d9fa5f tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:09.268981 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-98000d7f-f9d9-4664-bc03-7b02a4d9fa5f tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:09.270054 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-98000d7f-f9d9-4664-bc03-7b02a4d9fa5f tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:09.270695 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-98000d7f-f9d9-4664-bc03-7b02a4d9fa5f tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:09.440194 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-98000d7f-f9d9-4664-bc03-7b02a4d9fa5f tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:09.448730 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-98000d7f-f9d9-4664-bc03-7b02a4d9fa5f tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e" status: 200 len: 1275 microversion: 2.1 time: 0.214243 Dec 14 10:09:09.449820 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 70/142] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:09 2021] GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e => generated 1275 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:09.538301 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-b1aa5fe2-0e3d-443d-8e84-08e129775e7d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:09.550960 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-b1aa5fe2-0e3d-443d-8e84-08e129775e7d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.621619 Dec 14 10:09:09.553068 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 73/143] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:08 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:09.812609 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-039fed93-934b-4a07-9a66-104e6528a66b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:09.814558 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-039fed93-934b-4a07-9a66-104e6528a66b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:09.830247 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-039fed93-934b-4a07-9a66-104e6528a66b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:09.840859 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-039fed93-934b-4a07-9a66-104e6528a66b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:09.841682 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-039fed93-934b-4a07-9a66-104e6528a66b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:09.842148 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-039fed93-934b-4a07-9a66-104e6528a66b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:09.962441 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-039fed93-934b-4a07-9a66-104e6528a66b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 14 microversion: 2.1 time: 0.153680 Dec 14 10:09:09.965712 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 71/144] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:09 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 14 10:09:10.466127 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-61888ca6-e8ac-4488-a7e4-56b7d44cd677 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:10.466760 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-61888ca6-e8ac-4488-a7e4-56b7d44cd677 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:10.483208 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-61888ca6-e8ac-4488-a7e4-56b7d44cd677 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:10.483208 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-61888ca6-e8ac-4488-a7e4-56b7d44cd677 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:10.483208 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-61888ca6-e8ac-4488-a7e4-56b7d44cd677 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:10.483208 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-61888ca6-e8ac-4488-a7e4-56b7d44cd677 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:10.570943 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-23e88931-d34f-46a3-998a-94188d4bc071 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:10.571740 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-23e88931-d34f-46a3-998a-94188d4bc071 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:10.584344 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-23e88931-d34f-46a3-998a-94188d4bc071 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:10.584930 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-23e88931-d34f-46a3-998a-94188d4bc071 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:10.585867 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-23e88931-d34f-46a3-998a-94188d4bc071 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:10.586417 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-23e88931-d34f-46a3-998a-94188d4bc071 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:10.928323 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-23e88931-d34f-46a3-998a-94188d4bc071 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:10.940844 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-23e88931-d34f-46a3-998a-94188d4bc071 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.374790 Dec 14 10:09:10.941431 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 72/145] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:10 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:10.974305 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8deeeaf2-a46a-43dc-b61c-31987f954e74 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:10.975800 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-8deeeaf2-a46a-43dc-b61c-31987f954e74 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:10.996679 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8deeeaf2-a46a-43dc-b61c-31987f954e74 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:10.997230 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8deeeaf2-a46a-43dc-b61c-31987f954e74 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:10.998366 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8deeeaf2-a46a-43dc-b61c-31987f954e74 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:10.999506 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8deeeaf2-a46a-43dc-b61c-31987f954e74 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:11.168763 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8deeeaf2-a46a-43dc-b61c-31987f954e74 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 14 microversion: 2.1 time: 0.199544 Dec 14 10:09:11.169490 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 73/146] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:10 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 14 10:09:11.194426 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-61888ca6-e8ac-4488-a7e4-56b7d44cd677 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:11.202716 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-61888ca6-e8ac-4488-a7e4-56b7d44cd677 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e" status: 200 len: 1317 microversion: 2.1 time: 0.740277 Dec 14 10:09:11.213225 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 74/147] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:10 2021] GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e => generated 1317 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:11.691852 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-5885380d-ab70-4108-8bb5-7d5752c5135f req-ccf0dbfc-541a-43d6-aa5d-b8f8bd3ebbd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "717b2959-9c01-4993-bfb1-3b85f4245f2e", "tag": "09b07503-3722-4905-888c-f2166b4792da"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:11.695654 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:09:11.695654 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:09:11.725123 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-5885380d-ab70-4108-8bb5-7d5752c5135f req-ccf0dbfc-541a-43d6-aa5d-b8f8bd3ebbd0 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:11.726167 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-5885380d-ab70-4108-8bb5-7d5752c5135f req-ccf0dbfc-541a-43d6-aa5d-b8f8bd3ebbd0 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:11.746442 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-5885380d-ab70-4108-8bb5-7d5752c5135f req-ccf0dbfc-541a-43d6-aa5d-b8f8bd3ebbd0 service nova] Creating event network-changed:09b07503-3722-4905-888c-f2166b4792da for instance 717b2959-9c01-4993-bfb1-3b85f4245f2e on hv-cinder-81888 Dec 14 10:09:11.752664 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-5885380d-ab70-4108-8bb5-7d5752c5135f req-ccf0dbfc-541a-43d6-aa5d-b8f8bd3ebbd0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072387 Dec 14 10:09:11.753925 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 74/148] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:09:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:09:11.958297 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-cbc02fd1-a9dc-458b-b248-9df80cfc4591 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:11.959523 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-cbc02fd1-a9dc-458b-b248-9df80cfc4591 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:11.968708 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cbc02fd1-a9dc-458b-b248-9df80cfc4591 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:11.974035 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cbc02fd1-a9dc-458b-b248-9df80cfc4591 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:11.975427 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cbc02fd1-a9dc-458b-b248-9df80cfc4591 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:11.976020 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cbc02fd1-a9dc-458b-b248-9df80cfc4591 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:12.181004 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1ccd53bd-6d0c-470b-b209-6ddc1bf337b8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:12.182263 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1ccd53bd-6d0c-470b-b209-6ddc1bf337b8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:12.199040 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1ccd53bd-6d0c-470b-b209-6ddc1bf337b8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:12.199465 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1ccd53bd-6d0c-470b-b209-6ddc1bf337b8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:12.200437 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1ccd53bd-6d0c-470b-b209-6ddc1bf337b8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:12.204929 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1ccd53bd-6d0c-470b-b209-6ddc1bf337b8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:12.392838 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1ccd53bd-6d0c-470b-b209-6ddc1bf337b8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 14 microversion: 2.1 time: 0.216290 Dec 14 10:09:12.393474 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 75/149] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:12 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 14 10:09:12.398909 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-41eee918-4771-49ea-8e27-7a68e0f9a1c4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:12.399610 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-41eee918-4771-49ea-8e27-7a68e0f9a1c4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:12.408306 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-41eee918-4771-49ea-8e27-7a68e0f9a1c4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:12.409030 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-41eee918-4771-49ea-8e27-7a68e0f9a1c4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:12.409536 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-41eee918-4771-49ea-8e27-7a68e0f9a1c4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:12.409998 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-41eee918-4771-49ea-8e27-7a68e0f9a1c4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:12.570557 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-cbc02fd1-a9dc-458b-b248-9df80cfc4591 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:12.580100 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-cbc02fd1-a9dc-458b-b248-9df80cfc4591 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.626344 Dec 14 10:09:12.590275 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 75/150] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:11 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:12.590275 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-bd27e343-793d-4fb3-b0a1-96fb9e6fffc2 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:12.590275 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-bd27e343-793d-4fb3-b0a1-96fb9e6fffc2 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:12.608608 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bd27e343-793d-4fb3-b0a1-96fb9e6fffc2 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:12.609064 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bd27e343-793d-4fb3-b0a1-96fb9e6fffc2 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:12.609847 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bd27e343-793d-4fb3-b0a1-96fb9e6fffc2 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:12.610872 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bd27e343-793d-4fb3-b0a1-96fb9e6fffc2 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:12.824488 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-bd27e343-793d-4fb3-b0a1-96fb9e6fffc2 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Going to try to terminate instance {{(pid=100985) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:09:12.851894 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-41eee918-4771-49ea-8e27-7a68e0f9a1c4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:12.864658 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-41eee918-4771-49ea-8e27-7a68e0f9a1c4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e" status: 200 len: 1317 microversion: 2.1 time: 0.469798 Dec 14 10:09:12.865612 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 76/151] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:12 2021] GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:13.017302 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-bd27e343-793d-4fb3-b0a1-96fb9e6fffc2 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 204 len: 0 microversion: 2.1 time: 0.431980 Dec 14 10:09:13.018564 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 76/152] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:09:12 2021] DELETE /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 10:09:13.040158 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-ceb55e25-1f4c-4097-b7ea-ca395cc467f5 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:13.040988 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-ceb55e25-1f4c-4097-b7ea-ca395cc467f5 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:13.081741 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ceb55e25-1f4c-4097-b7ea-ca395cc467f5 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:13.087925 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ceb55e25-1f4c-4097-b7ea-ca395cc467f5 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:13.092322 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ceb55e25-1f4c-4097-b7ea-ca395cc467f5 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:13.098166 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ceb55e25-1f4c-4097-b7ea-ca395cc467f5 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:13.410664 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-5ea0abcd-279c-41ee-b0ac-9b85aa54992c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:13.411903 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-5ea0abcd-279c-41ee-b0ac-9b85aa54992c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:13.428142 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5ea0abcd-279c-41ee-b0ac-9b85aa54992c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:13.429623 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5ea0abcd-279c-41ee-b0ac-9b85aa54992c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:13.431917 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5ea0abcd-279c-41ee-b0ac-9b85aa54992c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:13.434053 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5ea0abcd-279c-41ee-b0ac-9b85aa54992c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:13.570406 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-ceb55e25-1f4c-4097-b7ea-ca395cc467f5 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:13.582549 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-5ea0abcd-279c-41ee-b0ac-9b85aa54992c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 14 microversion: 2.1 time: 0.182148 Dec 14 10:09:13.585752 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 77/153] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:13 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 10:09:13.587857 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-ceb55e25-1f4c-4097-b7ea-ca395cc467f5 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1554 microversion: 2.1 time: 0.557617 Dec 14 10:09:13.589388 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 77/154] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:13 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1554 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:13.604756 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e3ad4279-7e27-46d4-aaf4-b03c3bac8274 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:13.606434 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e3ad4279-7e27-46d4-aaf4-b03c3bac8274 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:13.614695 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e3ad4279-7e27-46d4-aaf4-b03c3bac8274 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:13.615475 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e3ad4279-7e27-46d4-aaf4-b03c3bac8274 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:13.617164 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e3ad4279-7e27-46d4-aaf4-b03c3bac8274 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:13.617787 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e3ad4279-7e27-46d4-aaf4-b03c3bac8274 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:13.883864 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c11037e8-3cd1-47ad-9bcb-4487f445a3be tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:13.885209 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c11037e8-3cd1-47ad-9bcb-4487f445a3be tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:13.895781 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c11037e8-3cd1-47ad-9bcb-4487f445a3be tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:13.896269 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c11037e8-3cd1-47ad-9bcb-4487f445a3be tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:13.897144 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c11037e8-3cd1-47ad-9bcb-4487f445a3be tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:13.897570 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c11037e8-3cd1-47ad-9bcb-4487f445a3be tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:14.207318 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c11037e8-3cd1-47ad-9bcb-4487f445a3be tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:14.207958 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-e3ad4279-7e27-46d4-aaf4-b03c3bac8274 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:14.218762 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e3ad4279-7e27-46d4-aaf4-b03c3bac8274 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.618044 Dec 14 10:09:14.219930 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 78/155] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:13 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:14.221009 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c11037e8-3cd1-47ad-9bcb-4487f445a3be tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e" status: 200 len: 1317 microversion: 2.1 time: 0.342371 Dec 14 10:09:14.221934 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 78/156] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:13 2021] GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e => generated 1317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:14.593525 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e9e4da1a-dc4a-48a2-a6ef-e3ed991cd2e7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:14.595907 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e9e4da1a-dc4a-48a2-a6ef-e3ed991cd2e7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:14.604078 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e9e4da1a-dc4a-48a2-a6ef-e3ed991cd2e7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:14.604297 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a6e110d5-64a9-4cc6-a2e3-66d66117491a tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:14.604555 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e9e4da1a-dc4a-48a2-a6ef-e3ed991cd2e7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:14.605075 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-a6e110d5-64a9-4cc6-a2e3-66d66117491a tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:14.605532 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e9e4da1a-dc4a-48a2-a6ef-e3ed991cd2e7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:14.605999 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e9e4da1a-dc4a-48a2-a6ef-e3ed991cd2e7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:14.613222 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a6e110d5-64a9-4cc6-a2e3-66d66117491a tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:14.613975 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a6e110d5-64a9-4cc6-a2e3-66d66117491a tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:14.614974 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a6e110d5-64a9-4cc6-a2e3-66d66117491a tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:14.615626 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a6e110d5-64a9-4cc6-a2e3-66d66117491a tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:14.799197 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e9e4da1a-dc4a-48a2-a6ef-e3ed991cd2e7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 14 microversion: 2.1 time: 0.209139 Dec 14 10:09:14.799912 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 79/157] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:14 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 14 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 14 10:09:14.852986 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-a6e110d5-64a9-4cc6-a2e3-66d66117491a tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:14.864912 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a6e110d5-64a9-4cc6-a2e3-66d66117491a tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1554 microversion: 2.1 time: 0.264144 Dec 14 10:09:14.865566 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 79/158] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:14 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1554 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:15.238822 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-083e9019-85dd-474c-878e-99c0d7b0388c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:15.239370 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1d7b1c99-9ae0-44d4-8312-3defa4bc84ba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:15.240546 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1d7b1c99-9ae0-44d4-8312-3defa4bc84ba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:15.240878 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-083e9019-85dd-474c-878e-99c0d7b0388c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:15.249140 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1d7b1c99-9ae0-44d4-8312-3defa4bc84ba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:15.249775 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1d7b1c99-9ae0-44d4-8312-3defa4bc84ba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:15.251443 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1d7b1c99-9ae0-44d4-8312-3defa4bc84ba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:15.252077 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1d7b1c99-9ae0-44d4-8312-3defa4bc84ba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:15.258090 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-083e9019-85dd-474c-878e-99c0d7b0388c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:15.258756 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-083e9019-85dd-474c-878e-99c0d7b0388c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:15.259539 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-083e9019-85dd-474c-878e-99c0d7b0388c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:15.260048 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-083e9019-85dd-474c-878e-99c0d7b0388c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:15.492368 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-083e9019-85dd-474c-878e-99c0d7b0388c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:15.501552 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-083e9019-85dd-474c-878e-99c0d7b0388c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.267764 Dec 14 10:09:15.502259 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 80/159] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:15 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:15.513206 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1d7b1c99-9ae0-44d4-8312-3defa4bc84ba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:15.521646 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1d7b1c99-9ae0-44d4-8312-3defa4bc84ba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e" status: 200 len: 1317 microversion: 2.1 time: 0.287861 Dec 14 10:09:15.522305 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 80/160] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:15 2021] GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:15.809650 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-7d89149b-5ecc-47d3-95f8-b251dceee05b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:15.810619 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-7d89149b-5ecc-47d3-95f8-b251dceee05b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:15.817963 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7d89149b-5ecc-47d3-95f8-b251dceee05b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:15.818997 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7d89149b-5ecc-47d3-95f8-b251dceee05b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:15.819192 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7d89149b-5ecc-47d3-95f8-b251dceee05b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:15.819783 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7d89149b-5ecc-47d3-95f8-b251dceee05b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:15.884133 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-73a57243-040d-4d59-a058-762a459c4073 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:15.884742 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-73a57243-040d-4d59-a058-762a459c4073 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:15.892736 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73a57243-040d-4d59-a058-762a459c4073 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:15.893350 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73a57243-040d-4d59-a058-762a459c4073 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:15.894340 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73a57243-040d-4d59-a058-762a459c4073 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:15.894769 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73a57243-040d-4d59-a058-762a459c4073 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:15.939244 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-7d89149b-5ecc-47d3-95f8-b251dceee05b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 14 microversion: 2.1 time: 0.132805 Dec 14 10:09:15.943096 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 81/161] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:15 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 14 10:09:16.214795 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-73a57243-040d-4d59-a058-762a459c4073 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:16.224701 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-73a57243-040d-4d59-a058-762a459c4073 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1554 microversion: 2.1 time: 0.344080 Dec 14 10:09:16.225296 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 81/162] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:15 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1554 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:16.519318 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-333cda4a-e4cf-4ae7-af7b-6085749a2074 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:16.523693 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-333cda4a-e4cf-4ae7-af7b-6085749a2074 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:16.533537 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-333cda4a-e4cf-4ae7-af7b-6085749a2074 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:16.534148 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-333cda4a-e4cf-4ae7-af7b-6085749a2074 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:16.534931 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-333cda4a-e4cf-4ae7-af7b-6085749a2074 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:16.535571 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-333cda4a-e4cf-4ae7-af7b-6085749a2074 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:16.539277 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5126b39c-7959-4fa8-8905-98f1c8bf6ec1 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:16.539960 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5126b39c-7959-4fa8-8905-98f1c8bf6ec1 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:16.547925 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5126b39c-7959-4fa8-8905-98f1c8bf6ec1 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:16.548729 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5126b39c-7959-4fa8-8905-98f1c8bf6ec1 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:16.549570 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5126b39c-7959-4fa8-8905-98f1c8bf6ec1 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:16.550615 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5126b39c-7959-4fa8-8905-98f1c8bf6ec1 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:16.759431 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5126b39c-7959-4fa8-8905-98f1c8bf6ec1 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:16.767726 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5126b39c-7959-4fa8-8905-98f1c8bf6ec1 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e" status: 200 len: 1317 microversion: 2.1 time: 0.232185 Dec 14 10:09:16.768298 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 82/163] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:16 2021] GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:16.950170 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-450c7794-855c-41f7-b1cb-f8229e214066 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:16.951316 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-450c7794-855c-41f7-b1cb-f8229e214066 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:16.961334 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-450c7794-855c-41f7-b1cb-f8229e214066 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:16.961920 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-450c7794-855c-41f7-b1cb-f8229e214066 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:16.962828 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-450c7794-855c-41f7-b1cb-f8229e214066 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:16.963466 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-450c7794-855c-41f7-b1cb-f8229e214066 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:17.080871 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-450c7794-855c-41f7-b1cb-f8229e214066 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 14 microversion: 2.1 time: 0.134154 Dec 14 10:09:17.081508 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 83/164] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:16 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 10:09:17.243432 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d9eddfdd-1472-4eab-be84-55894d58c3d8 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:17.244308 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d9eddfdd-1472-4eab-be84-55894d58c3d8 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:17.269032 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d9eddfdd-1472-4eab-be84-55894d58c3d8 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:17.269773 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d9eddfdd-1472-4eab-be84-55894d58c3d8 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:17.271225 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d9eddfdd-1472-4eab-be84-55894d58c3d8 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:17.272207 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d9eddfdd-1472-4eab-be84-55894d58c3d8 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:17.280435 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-333cda4a-e4cf-4ae7-af7b-6085749a2074 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:17.293781 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-333cda4a-e4cf-4ae7-af7b-6085749a2074 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.778301 Dec 14 10:09:17.294402 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 82/165] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:16 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:17.534084 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d9eddfdd-1472-4eab-be84-55894d58c3d8 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:17.553663 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d9eddfdd-1472-4eab-be84-55894d58c3d8 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1554 microversion: 2.1 time: 0.313969 Dec 14 10:09:17.565016 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 84/166] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:17 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1554 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:17.627523 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-d1f77baa-9940-4268-948e-e58140bd68a8 req-1ff633e3-700e-4720-b722-02e1cabf29d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e89d5e41-df1a-438d-b051-8b9dd0104644", "name": "network-vif-deleted", "tag": "b88f6614-94a6-49ff-aab2-e715637e1e86"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:17.627523 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:09:17.627523 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:09:17.632148 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-d1f77baa-9940-4268-948e-e58140bd68a8 req-1ff633e3-700e-4720-b722-02e1cabf29d9 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:17.632588 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-d1f77baa-9940-4268-948e-e58140bd68a8 req-1ff633e3-700e-4720-b722-02e1cabf29d9 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:17.652503 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-d1f77baa-9940-4268-948e-e58140bd68a8 req-1ff633e3-700e-4720-b722-02e1cabf29d9 service nova] Creating event network-vif-deleted:b88f6614-94a6-49ff-aab2-e715637e1e86 for instance e89d5e41-df1a-438d-b051-8b9dd0104644 on hv-cinder-81888 Dec 14 10:09:17.659353 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-d1f77baa-9940-4268-948e-e58140bd68a8 req-1ff633e3-700e-4720-b722-02e1cabf29d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041950 Dec 14 10:09:17.660328 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 83/167] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:09:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:09:17.784730 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-45a8a38c-36ed-4ec1-8461-a475c358cb09 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:17.785345 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-45a8a38c-36ed-4ec1-8461-a475c358cb09 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:17.792737 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-45a8a38c-36ed-4ec1-8461-a475c358cb09 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:17.793141 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-45a8a38c-36ed-4ec1-8461-a475c358cb09 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:17.793911 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-45a8a38c-36ed-4ec1-8461-a475c358cb09 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:17.794364 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-45a8a38c-36ed-4ec1-8461-a475c358cb09 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:18.045708 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-45a8a38c-36ed-4ec1-8461-a475c358cb09 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:18.054090 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-45a8a38c-36ed-4ec1-8461-a475c358cb09 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e" status: 200 len: 1317 microversion: 2.1 time: 0.273276 Dec 14 10:09:18.054653 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 85/168] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:17 2021] GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:18.092588 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c8e0ad92-568f-4bd4-84bd-0f663f10d73d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:18.093816 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c8e0ad92-568f-4bd4-84bd-0f663f10d73d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:18.102218 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c8e0ad92-568f-4bd4-84bd-0f663f10d73d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:18.102921 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c8e0ad92-568f-4bd4-84bd-0f663f10d73d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:18.103768 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c8e0ad92-568f-4bd4-84bd-0f663f10d73d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:18.104269 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c8e0ad92-568f-4bd4-84bd-0f663f10d73d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:18.200882 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c8e0ad92-568f-4bd4-84bd-0f663f10d73d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 14 microversion: 2.1 time: 0.112435 Dec 14 10:09:18.201537 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 84/169] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:18 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 10:09:18.312148 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-dc19058e-0a56-42fe-9b6a-8f00f4cf77ef tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:18.312887 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-dc19058e-0a56-42fe-9b6a-8f00f4cf77ef tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:18.321314 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dc19058e-0a56-42fe-9b6a-8f00f4cf77ef tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:18.322169 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dc19058e-0a56-42fe-9b6a-8f00f4cf77ef tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:18.323685 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dc19058e-0a56-42fe-9b6a-8f00f4cf77ef tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:18.337104 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dc19058e-0a56-42fe-9b6a-8f00f4cf77ef tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:18.571596 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-47f43860-bcda-4c16-8ce0-aa2bea6996e0 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:18.572281 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-47f43860-bcda-4c16-8ce0-aa2bea6996e0 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:18.585403 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-47f43860-bcda-4c16-8ce0-aa2bea6996e0 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:18.586384 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-47f43860-bcda-4c16-8ce0-aa2bea6996e0 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:18.587413 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-47f43860-bcda-4c16-8ce0-aa2bea6996e0 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:18.587999 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-47f43860-bcda-4c16-8ce0-aa2bea6996e0 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:18.618450 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-dc19058e-0a56-42fe-9b6a-8f00f4cf77ef tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:18.627379 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-dc19058e-0a56-42fe-9b6a-8f00f4cf77ef tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.319055 Dec 14 10:09:18.628117 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 86/170] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:18 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:18.665663 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-47f43860-bcda-4c16-8ce0-aa2bea6996e0 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:18.666257 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-47f43860-bcda-4c16-8ce0-aa2bea6996e0 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:18.666589 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.objects.instance [None req-47f43860-bcda-4c16-8ce0-aa2bea6996e0 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lazy-loading 'fault' on Instance uuid e89d5e41-df1a-438d-b051-8b9dd0104644 {{(pid=100985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:09:18.756692 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-47f43860-bcda-4c16-8ce0-aa2bea6996e0 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff2574f3d80644ac8d45f5e1be1c342c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185d9933ced42d0b30077f0febbc3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:18.767705 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-47f43860-bcda-4c16-8ce0-aa2bea6996e0 tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 200 len: 1350 microversion: 2.1 time: 0.200049 Dec 14 10:09:18.768578 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 85/171] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:18 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 1350 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:19.071516 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4e96e488-cc53-4b6a-a49a-e476edb5b03e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:19.072382 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4e96e488-cc53-4b6a-a49a-e476edb5b03e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:19.080786 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4e96e488-cc53-4b6a-a49a-e476edb5b03e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:19.080786 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4e96e488-cc53-4b6a-a49a-e476edb5b03e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:19.081542 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4e96e488-cc53-4b6a-a49a-e476edb5b03e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:19.081975 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4e96e488-cc53-4b6a-a49a-e476edb5b03e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:19.130729 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-10023005-ed7b-48de-b19c-e5d1ce768de9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-986036559", "imageRef": "5be36fdc-2baa-4efd-b830-5a5c3fd7beba", "flavorRef": "452", "networks": [{"uuid": "4613aaa2-a4df-463e-b247-3ca86ac39e26"}]}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:19.303620 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4e96e488-cc53-4b6a-a49a-e476edb5b03e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:19.311784 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4e96e488-cc53-4b6a-a49a-e476edb5b03e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e" status: 200 len: 1317 microversion: 2.1 time: 0.243946 Dec 14 10:09:19.312345 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 87/172] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:19 2021] GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:19.325465 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-ff185d24-10d3-489f-adbe-4334ece4bca0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:19.326385 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-ff185d24-10d3-489f-adbe-4334ece4bca0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:19.334589 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ff185d24-10d3-489f-adbe-4334ece4bca0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:19.335033 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ff185d24-10d3-489f-adbe-4334ece4bca0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:19.336048 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ff185d24-10d3-489f-adbe-4334ece4bca0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:19.336645 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ff185d24-10d3-489f-adbe-4334ece4bca0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:19.455111 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-ff185d24-10d3-489f-adbe-4334ece4bca0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 14 microversion: 2.1 time: 0.131886 Dec 14 10:09:19.458367 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 88/173] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:19 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 10:09:19.656225 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-73efdc93-d047-486b-9d89-c51dd53ca13f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:19.658442 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-73efdc93-d047-486b-9d89-c51dd53ca13f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:19.669284 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73efdc93-d047-486b-9d89-c51dd53ca13f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:19.670796 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73efdc93-d047-486b-9d89-c51dd53ca13f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:19.671783 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73efdc93-d047-486b-9d89-c51dd53ca13f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:19.672400 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73efdc93-d047-486b-9d89-c51dd53ca13f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:19.882534 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-73efdc93-d047-486b-9d89-c51dd53ca13f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:19.893755 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-73efdc93-d047-486b-9d89-c51dd53ca13f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.253081 Dec 14 10:09:19.894595 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 89/174] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:19 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:19.900940 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-423ded46-d76d-44e5-8e22-f722ab7fe07c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:19.901852 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-423ded46-d76d-44e5-8e22-f722ab7fe07c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:19.913032 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-423ded46-d76d-44e5-8e22-f722ab7fe07c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:19.913482 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-423ded46-d76d-44e5-8e22-f722ab7fe07c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:19.914290 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-423ded46-d76d-44e5-8e22-f722ab7fe07c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:19.914725 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-423ded46-d76d-44e5-8e22-f722ab7fe07c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:19.971663 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-423ded46-d76d-44e5-8e22-f722ab7fe07c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] HTTP exception thrown: Instance e89d5e41-df1a-438d-b051-8b9dd0104644 could not be found. Dec 14 10:09:19.972280 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-423ded46-d76d-44e5-8e22-f722ab7fe07c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Returning 404 to user: Instance e89d5e41-df1a-438d-b051-8b9dd0104644 could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:09:19.973121 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-423ded46-d76d-44e5-8e22-f722ab7fe07c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 404 len: 111 microversion: 2.1 time: 0.076804 Dec 14 10:09:19.973878 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 90/175] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:19 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:09:20.005494 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-c924de4e-fdc5-4876-8c30-4ec54cbfcfa5 req-c243adf4-c613-403b-aedc-5766ea6a6255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "717b2959-9c01-4993-bfb1-3b85f4245f2e", "name": "network-vif-plugged", "status": "completed", "tag": "09b07503-3722-4905-888c-f2166b4792da"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:20.007119 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:09:20.007119 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:09:20.017577 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-c924de4e-fdc5-4876-8c30-4ec54cbfcfa5 req-c243adf4-c613-403b-aedc-5766ea6a6255 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:20.018242 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-c924de4e-fdc5-4876-8c30-4ec54cbfcfa5 req-c243adf4-c613-403b-aedc-5766ea6a6255 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:20.036269 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-c924de4e-fdc5-4876-8c30-4ec54cbfcfa5 req-c243adf4-c613-403b-aedc-5766ea6a6255 service nova] Creating event network-vif-plugged:09b07503-3722-4905-888c-f2166b4792da for instance 717b2959-9c01-4993-bfb1-3b85f4245f2e on hv-cinder-81888 Dec 14 10:09:20.042062 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-c924de4e-fdc5-4876-8c30-4ec54cbfcfa5 req-c243adf4-c613-403b-aedc-5766ea6a6255 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041064 Dec 14 10:09:20.043199 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 91/176] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:09:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:09:20.245509 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-16c6cdff-6986-4057-83a4-f44ecd50b5ba tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:20.246787 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-16c6cdff-6986-4057-83a4-f44ecd50b5ba tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:20.256672 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-16c6cdff-6986-4057-83a4-f44ecd50b5ba tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:20.257398 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-16c6cdff-6986-4057-83a4-f44ecd50b5ba tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:20.258703 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-16c6cdff-6986-4057-83a4-f44ecd50b5ba tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:20.259433 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-16c6cdff-6986-4057-83a4-f44ecd50b5ba tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:20.311594 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-16c6cdff-6986-4057-83a4-f44ecd50b5ba tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] HTTP exception thrown: Instance e89d5e41-df1a-438d-b051-8b9dd0104644 could not be found. Dec 14 10:09:20.312269 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-16c6cdff-6986-4057-83a4-f44ecd50b5ba tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Returning 404 to user: Instance e89d5e41-df1a-438d-b051-8b9dd0104644 could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:09:20.313708 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-16c6cdff-6986-4057-83a4-f44ecd50b5ba tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.072053 Dec 14 10:09:20.314876 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 92/177] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:09:20 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644/os-volume_attachments => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 14 10:09:20.330341 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-b07da37f-59f2-41dd-b17b-cd08c79cfd8b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:20.331026 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-b07da37f-59f2-41dd-b17b-cd08c79cfd8b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:20.340303 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b07da37f-59f2-41dd-b17b-cd08c79cfd8b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:20.342533 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b07da37f-59f2-41dd-b17b-cd08c79cfd8b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:20.343462 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b07da37f-59f2-41dd-b17b-cd08c79cfd8b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:20.343986 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b07da37f-59f2-41dd-b17b-cd08c79cfd8b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:20.568052 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-b07da37f-59f2-41dd-b17b-cd08c79cfd8b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:20.581359 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-b07da37f-59f2-41dd-b17b-cd08c79cfd8b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e" status: 200 len: 1317 microversion: 2.1 time: 0.255737 Dec 14 10:09:20.585403 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 93/178] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:20 2021] GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:20.590222 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-43e4b819-ee42-4061-b03a-f9229e7314a4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:20.591327 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-43e4b819-ee42-4061-b03a-f9229e7314a4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:20.599738 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-43e4b819-ee42-4061-b03a-f9229e7314a4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:20.600187 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-43e4b819-ee42-4061-b03a-f9229e7314a4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:20.600956 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-43e4b819-ee42-4061-b03a-f9229e7314a4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:20.601403 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-43e4b819-ee42-4061-b03a-f9229e7314a4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:20.709936 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-43e4b819-ee42-4061-b03a-f9229e7314a4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 14 microversion: 2.1 time: 0.122866 Dec 14 10:09:20.710745 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 94/179] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:20 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 10:09:20.914145 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-df9076e2-00e9-446f-9dd3-2ebc38fd18d5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:20.914957 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-df9076e2-00e9-446f-9dd3-2ebc38fd18d5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:20.930252 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-df9076e2-00e9-446f-9dd3-2ebc38fd18d5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:20.930725 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-df9076e2-00e9-446f-9dd3-2ebc38fd18d5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:20.931521 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-df9076e2-00e9-446f-9dd3-2ebc38fd18d5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:20.931944 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-df9076e2-00e9-446f-9dd3-2ebc38fd18d5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:21.141245 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-df9076e2-00e9-446f-9dd3-2ebc38fd18d5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:21.149974 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-df9076e2-00e9-446f-9dd3-2ebc38fd18d5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.241799 Dec 14 10:09:21.150663 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 95/180] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:20 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:21.600678 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-21c84205-9bf0-4e78-9c3e-a5683d382f9b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:21.601296 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-21c84205-9bf0-4e78-9c3e-a5683d382f9b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:21.608413 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-21c84205-9bf0-4e78-9c3e-a5683d382f9b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:21.608862 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-21c84205-9bf0-4e78-9c3e-a5683d382f9b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:21.609631 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-21c84205-9bf0-4e78-9c3e-a5683d382f9b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:21.610592 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-21c84205-9bf0-4e78-9c3e-a5683d382f9b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:21.828040 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-21c84205-9bf0-4e78-9c3e-a5683d382f9b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:21.836487 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-21c84205-9bf0-4e78-9c3e-a5683d382f9b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e" status: 200 len: 1317 microversion: 2.1 time: 0.239356 Dec 14 10:09:21.837350 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 96/181] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:21 2021] GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:21.841981 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-baa369d9-8721-409a-85d5-c106ae443d0e tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:21.842540 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-baa369d9-8721-409a-85d5-c106ae443d0e tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:21.851192 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-baa369d9-8721-409a-85d5-c106ae443d0e tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:21.851672 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-baa369d9-8721-409a-85d5-c106ae443d0e tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:21.852665 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-baa369d9-8721-409a-85d5-c106ae443d0e tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:21.853290 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-baa369d9-8721-409a-85d5-c106ae443d0e tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:21.913022 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-baa369d9-8721-409a-85d5-c106ae443d0e tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] HTTP exception thrown: Instance e89d5e41-df1a-438d-b051-8b9dd0104644 could not be found. Dec 14 10:09:21.914504 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-baa369d9-8721-409a-85d5-c106ae443d0e tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Returning 404 to user: Instance e89d5e41-df1a-438d-b051-8b9dd0104644 could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:09:21.915681 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-baa369d9-8721-409a-85d5-c106ae443d0e tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 404 len: 111 microversion: 2.1 time: 0.076993 Dec 14 10:09:21.916247 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 97/182] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:09:21 2021] DELETE /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:09:21.920859 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-14403b0c-987f-4f6f-a8e1-ba49d70ad9b6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:21.921857 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-14403b0c-987f-4f6f-a8e1-ba49d70ad9b6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:21.930364 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-14403b0c-987f-4f6f-a8e1-ba49d70ad9b6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:21.930737 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-14403b0c-987f-4f6f-a8e1-ba49d70ad9b6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:21.931506 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-14403b0c-987f-4f6f-a8e1-ba49d70ad9b6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:21.931938 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-14403b0c-987f-4f6f-a8e1-ba49d70ad9b6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:22.038555 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-14403b0c-987f-4f6f-a8e1-ba49d70ad9b6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 14 microversion: 2.1 time: 0.120865 Dec 14 10:09:22.039468 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 98/183] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:21 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 10:09:22.046175 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-dd21b45f-aba2-4c5c-9a30-332aa5b7e82c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:22.046878 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-dd21b45f-aba2-4c5c-9a30-332aa5b7e82c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] [instance: e89d5e41-df1a-438d-b051-8b9dd0104644] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:22.056980 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dd21b45f-aba2-4c5c-9a30-332aa5b7e82c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:22.057422 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dd21b45f-aba2-4c5c-9a30-332aa5b7e82c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:22.058233 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dd21b45f-aba2-4c5c-9a30-332aa5b7e82c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:22.058665 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dd21b45f-aba2-4c5c-9a30-332aa5b7e82c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:22.110233 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-dd21b45f-aba2-4c5c-9a30-332aa5b7e82c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] HTTP exception thrown: Instance e89d5e41-df1a-438d-b051-8b9dd0104644 could not be found. Dec 14 10:09:22.111208 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-dd21b45f-aba2-4c5c-9a30-332aa5b7e82c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] Returning 404 to user: Instance e89d5e41-df1a-438d-b051-8b9dd0104644 could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:09:22.112057 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-dd21b45f-aba2-4c5c-9a30-332aa5b7e82c tempest-DeleteServersTestJSON-1922588090 tempest-DeleteServersTestJSON-1922588090-project] 10.222.0.20 "GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644" status: 404 len: 111 microversion: 2.1 time: 0.071118 Dec 14 10:09:22.112589 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 99/184] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:22 2021] GET /compute/v2.1/servers/e89d5e41-df1a-438d-b051-8b9dd0104644 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:09:22.167364 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-dd0c5143-6982-42b3-bace-644ee6952a3b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:22.167978 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-dd0c5143-6982-42b3-bace-644ee6952a3b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:22.175735 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dd0c5143-6982-42b3-bace-644ee6952a3b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:22.176177 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dd0c5143-6982-42b3-bace-644ee6952a3b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:22.176944 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dd0c5143-6982-42b3-bace-644ee6952a3b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:22.177377 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dd0c5143-6982-42b3-bace-644ee6952a3b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:22.511122 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-dd0c5143-6982-42b3-bace-644ee6952a3b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:22.519488 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-dd0c5143-6982-42b3-bace-644ee6952a3b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.355807 Dec 14 10:09:22.520052 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 100/185] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:22 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:22.853304 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-6e37518f-f8ff-49ab-9a90-3dd46c5bfcc4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:22.854051 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-6e37518f-f8ff-49ab-9a90-3dd46c5bfcc4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:22.867407 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6e37518f-f8ff-49ab-9a90-3dd46c5bfcc4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:22.867407 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6e37518f-f8ff-49ab-9a90-3dd46c5bfcc4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:22.867407 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6e37518f-f8ff-49ab-9a90-3dd46c5bfcc4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:22.867407 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6e37518f-f8ff-49ab-9a90-3dd46c5bfcc4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:23.133376 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-6e37518f-f8ff-49ab-9a90-3dd46c5bfcc4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:23.142243 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-6e37518f-f8ff-49ab-9a90-3dd46c5bfcc4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e" status: 200 len: 1507 microversion: 2.1 time: 0.292751 Dec 14 10:09:23.142815 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 101/186] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:22 2021] GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e => generated 1507 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:23.158821 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8da27fae-c5d7-454d-a473-e1af730ab787 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:23.159746 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-8da27fae-c5d7-454d-a473-e1af730ab787 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:23.168143 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8da27fae-c5d7-454d-a473-e1af730ab787 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:23.168596 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8da27fae-c5d7-454d-a473-e1af730ab787 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:23.169627 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8da27fae-c5d7-454d-a473-e1af730ab787 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:23.170745 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8da27fae-c5d7-454d-a473-e1af730ab787 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:23.290385 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8da27fae-c5d7-454d-a473-e1af730ab787 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 5473 microversion: 2.1 time: 0.135582 Dec 14 10:09:23.294222 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 102/187] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:23 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 5473 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:23.296664 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-647e7dd7-f6ff-4eab-9901-9f166e218298 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d71a5bc6-ab84-4686-9adb-7196ada466ad"}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:23.298174 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-647e7dd7-f6ff-4eab-9901-9f166e218298 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:23.306155 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-647e7dd7-f6ff-4eab-9901-9f166e218298 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:23.306594 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-647e7dd7-f6ff-4eab-9901-9f166e218298 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:23.307363 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-647e7dd7-f6ff-4eab-9901-9f166e218298 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:23.307787 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-647e7dd7-f6ff-4eab-9901-9f166e218298 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:23.461414 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-647e7dd7-f6ff-4eab-9901-9f166e218298 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] HTTP exception thrown: Invalid volume: volume d71a5bc6-ab84-4686-9adb-7196ada466ad is already attached to instances: 35b66506-2460-4284-aa1e-c7b2f368bb75 Dec 14 10:09:23.462045 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-647e7dd7-f6ff-4eab-9901-9f166e218298 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Returning 400 to user: Invalid volume: volume d71a5bc6-ab84-4686-9adb-7196ada466ad is already attached to instances: 35b66506-2460-4284-aa1e-c7b2f368bb75 {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:09:23.462876 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-647e7dd7-f6ff-4eab-9901-9f166e218298 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "POST /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.170691 Dec 14 10:09:23.463441 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 103/188] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Dec 14 10:09:23 2021] POST /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e/os-volume_attachments => generated 174 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 14 10:09:23.537106 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8ecee0c0-6065-42a8-963e-5557e43c5555 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:23.537885 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-8ecee0c0-6065-42a8-963e-5557e43c5555 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:23.545925 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8ecee0c0-6065-42a8-963e-5557e43c5555 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:23.546423 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8ecee0c0-6065-42a8-963e-5557e43c5555 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:23.547234 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8ecee0c0-6065-42a8-963e-5557e43c5555 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:23.548325 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8ecee0c0-6065-42a8-963e-5557e43c5555 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:23.904290 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-8ecee0c0-6065-42a8-963e-5557e43c5555 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:23.912757 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8ecee0c0-6065-42a8-963e-5557e43c5555 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.379525 Dec 14 10:09:23.913318 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 104/189] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:23 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:23.919242 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-986a9980-3c6f-4469-9e25-ca1271638822 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:23.919798 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-986a9980-3c6f-4469-9e25-ca1271638822 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:23.928110 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-986a9980-3c6f-4469-9e25-ca1271638822 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:23.928552 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-986a9980-3c6f-4469-9e25-ca1271638822 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:23.929320 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-986a9980-3c6f-4469-9e25-ca1271638822 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:23.929746 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-986a9980-3c6f-4469-9e25-ca1271638822 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:24.091073 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.objects.instance [None req-986a9980-3c6f-4469-9e25-ca1271638822 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lazy-loading 'services' on Instance uuid 35b66506-2460-4284-aa1e-c7b2f368bb75 {{(pid=100984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:09:24.248350 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-986a9980-3c6f-4469-9e25-ca1271638822 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75/os-volume_attachments/d71a5bc6-ab84-4686-9adb-7196ada466ad" status: 202 len: 0 microversion: 2.1 time: 0.333759 Dec 14 10:09:24.248962 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 105/190] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Dec 14 10:09:23 2021] DELETE /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75/os-volume_attachments/d71a5bc6-ab84-4686-9adb-7196ada466ad => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:09:24.258422 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f83853df-d1d7-4e91-a760-aac6592452e4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:24.259575 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f83853df-d1d7-4e91-a760-aac6592452e4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:24.267684 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f83853df-d1d7-4e91-a760-aac6592452e4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:24.268445 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f83853df-d1d7-4e91-a760-aac6592452e4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:24.269512 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f83853df-d1d7-4e91-a760-aac6592452e4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:24.270090 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f83853df-d1d7-4e91-a760-aac6592452e4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:24.346338 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f83853df-d1d7-4e91-a760-aac6592452e4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091867 Dec 14 10:09:24.347980 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 106/191] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:09:24 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:09:24.354459 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-bc0c7781-957a-4d57-baec-39ddfc164e74 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:24.355570 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-bc0c7781-957a-4d57-baec-39ddfc164e74 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:24.365231 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bc0c7781-957a-4d57-baec-39ddfc164e74 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:24.365787 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bc0c7781-957a-4d57-baec-39ddfc164e74 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:24.366894 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bc0c7781-957a-4d57-baec-39ddfc164e74 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:24.367466 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bc0c7781-957a-4d57-baec-39ddfc164e74 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:24.522786 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-bc0c7781-957a-4d57-baec-39ddfc164e74 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 11454 microversion: 2.1 time: 0.173308 Dec 14 10:09:24.528903 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 107/192] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:24 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 11454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:09:24.936243 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c2c201a9-3e5c-4577-b304-4f11f55d27a8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:24.936957 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c2c201a9-3e5c-4577-b304-4f11f55d27a8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:24.953115 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c2c201a9-3e5c-4577-b304-4f11f55d27a8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:24.954311 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c2c201a9-3e5c-4577-b304-4f11f55d27a8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:24.955020 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c2c201a9-3e5c-4577-b304-4f11f55d27a8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:24.955452 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c2c201a9-3e5c-4577-b304-4f11f55d27a8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:25.189874 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c2c201a9-3e5c-4577-b304-4f11f55d27a8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:25.199047 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c2c201a9-3e5c-4577-b304-4f11f55d27a8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.272194 Dec 14 10:09:25.199893 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 108/193] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:24 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:25.357670 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4c7debef-6844-4198-9746-206fa5c62030 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:25.358937 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4c7debef-6844-4198-9746-206fa5c62030 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:25.369947 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4c7debef-6844-4198-9746-206fa5c62030 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:25.370427 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4c7debef-6844-4198-9746-206fa5c62030 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:25.371205 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4c7debef-6844-4198-9746-206fa5c62030 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:25.371639 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4c7debef-6844-4198-9746-206fa5c62030 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:25.449061 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4c7debef-6844-4198-9746-206fa5c62030 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095266 Dec 14 10:09:25.449630 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 109/194] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:09:25 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:09:25.536374 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-aabdbbd2-b6f6-4021-bed0-ef530f73954e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:25.537526 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-aabdbbd2-b6f6-4021-bed0-ef530f73954e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:25.550435 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aabdbbd2-b6f6-4021-bed0-ef530f73954e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:25.550965 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aabdbbd2-b6f6-4021-bed0-ef530f73954e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:25.551750 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aabdbbd2-b6f6-4021-bed0-ef530f73954e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:25.552189 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aabdbbd2-b6f6-4021-bed0-ef530f73954e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:25.727861 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-aabdbbd2-b6f6-4021-bed0-ef530f73954e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 15064 microversion: 2.1 time: 0.196457 Dec 14 10:09:25.728896 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 110/195] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:25 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 15064 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:09:26.218601 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5f271eaa-d40a-46f0-80a0-2f893dab54bf tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:26.220211 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5f271eaa-d40a-46f0-80a0-2f893dab54bf tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:26.228691 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5f271eaa-d40a-46f0-80a0-2f893dab54bf tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:26.229230 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5f271eaa-d40a-46f0-80a0-2f893dab54bf tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:26.230128 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5f271eaa-d40a-46f0-80a0-2f893dab54bf tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:26.230628 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5f271eaa-d40a-46f0-80a0-2f893dab54bf tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:26.269333 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.network.neutron [None req-10023005-ed7b-48de-b19c-e5d1ce768de9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] validate_networks() for [('4613aaa2-a4df-463e-b247-3ca86ac39e26', None, None, None)] {{(pid=100985) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:09:26.459193 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5f271eaa-d40a-46f0-80a0-2f893dab54bf tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:26.468107 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5f271eaa-d40a-46f0-80a0-2f893dab54bf tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.255064 Dec 14 10:09:26.468671 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 111/196] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:26 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:26.473095 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-2a04c575-36b8-41ce-9209-424c3a2d83f5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:26.474195 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-2a04c575-36b8-41ce-9209-424c3a2d83f5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:26.482772 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2a04c575-36b8-41ce-9209-424c3a2d83f5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:26.483207 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2a04c575-36b8-41ce-9209-424c3a2d83f5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:26.484162 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2a04c575-36b8-41ce-9209-424c3a2d83f5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:26.484589 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2a04c575-36b8-41ce-9209-424c3a2d83f5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:26.581075 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-2a04c575-36b8-41ce-9209-424c3a2d83f5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.111163 Dec 14 10:09:26.586132 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 112/197] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:09:26 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 10:09:26.739784 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-ba73967d-c0b7-4f8e-bb3f-f2c27febcb89 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:26.740800 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-ba73967d-c0b7-4f8e-bb3f-f2c27febcb89 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:26.749719 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ba73967d-c0b7-4f8e-bb3f-f2c27febcb89 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:26.751329 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ba73967d-c0b7-4f8e-bb3f-f2c27febcb89 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:26.752367 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ba73967d-c0b7-4f8e-bb3f-f2c27febcb89 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:26.752946 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ba73967d-c0b7-4f8e-bb3f-f2c27febcb89 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:26.870066 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-10023005-ed7b-48de-b19c-e5d1ce768de9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Flavor limits 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:09:26.870508 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-10023005-ed7b-48de-b19c-e5d1ce768de9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Image limits 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:09:26.870989 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-10023005-ed7b-48de-b19c-e5d1ce768de9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Flavor pref 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:09:26.871402 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-10023005-ed7b-48de-b19c-e5d1ce768de9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Image pref 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:09:26.871803 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-10023005-ed7b-48de-b19c-e5d1ce768de9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:09:26.880101 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-ba73967d-c0b7-4f8e-bb3f-f2c27febcb89 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 17914 microversion: 2.1 time: 0.144122 Dec 14 10:09:26.880738 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 113/198] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:26 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 17914 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:09:26.880935 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-10023005-ed7b-48de-b19c-e5d1ce768de9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:26.881589 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-10023005-ed7b-48de-b19c-e5d1ce768de9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:26.882574 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-10023005-ed7b-48de-b19c-e5d1ce768de9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:26.883135 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-10023005-ed7b-48de-b19c-e5d1ce768de9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:26.887263 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-b58f3eef-4510-464e-bead-32b633d03f00 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1598378817", "imageRef": "5be36fdc-2baa-4efd-b830-5a5c3fd7beba", "flavorRef": "452", "networks": [{"uuid": "fcd0582b-f091-4bb6-bfce-2519464100b0"}]}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:26.901240 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-10023005-ed7b-48de-b19c-e5d1ce768de9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Getting quotas for project 2526870696444f07a95751c539846668. Resources: {'cores', 'instances', 'ram'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:09:26.905540 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-10023005-ed7b-48de-b19c-e5d1ce768de9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Getting quotas for user 1315f20a3c734bdebe2197a7cc4d9064 and project 2526870696444f07a95751c539846668. Resources: {'cores', 'instances', 'ram'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:09:26.916662 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-10023005-ed7b-48de-b19c-e5d1ce768de9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Going to run 1 instances... {{(pid=100985) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:09:26.918981 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-10023005-ed7b-48de-b19c-e5d1ce768de9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5be36fdc-2baa-4efd-b830-5a5c3fd7beba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:09:26.955075 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.network.neutron [None req-b58f3eef-4510-464e-bead-32b633d03f00 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] validate_networks() for [('fcd0582b-f091-4bb6-bfce-2519464100b0', None, None, None)] {{(pid=100984) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:09:26.969813 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-10023005-ed7b-48de-b19c-e5d1ce768de9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.844148 Dec 14 10:09:26.970658 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 86/199] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Dec 14 10:09:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 7846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 14 10:09:26.980388 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-07efea0c-9a7a-4c1d-adee-727e66758069 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:26.981201 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-07efea0c-9a7a-4c1d-adee-727e66758069 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:27.075565 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-07efea0c-9a7a-4c1d-adee-727e66758069 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:27.088616 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-07efea0c-9a7a-4c1d-adee-727e66758069 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1218 microversion: 2.1 time: 0.111869 Dec 14 10:09:27.089193 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 87/200] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:26 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:27.486491 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-03af7450-d68a-4591-9d72-f145110f4cdd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:27.487196 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-03af7450-d68a-4591-9d72-f145110f4cdd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:27.494547 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-03af7450-d68a-4591-9d72-f145110f4cdd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:27.495093 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-03af7450-d68a-4591-9d72-f145110f4cdd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:27.495977 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-03af7450-d68a-4591-9d72-f145110f4cdd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:27.496505 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-03af7450-d68a-4591-9d72-f145110f4cdd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:27.632304 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-b58f3eef-4510-464e-bead-32b633d03f00 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Flavor limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:09:27.632804 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-b58f3eef-4510-464e-bead-32b633d03f00 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Image limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:09:27.633164 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-b58f3eef-4510-464e-bead-32b633d03f00 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Flavor pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:09:27.633806 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-b58f3eef-4510-464e-bead-32b633d03f00 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Image pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:09:27.634237 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-b58f3eef-4510-464e-bead-32b633d03f00 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:09:27.643949 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b58f3eef-4510-464e-bead-32b633d03f00 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:27.644388 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b58f3eef-4510-464e-bead-32b633d03f00 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:27.645167 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b58f3eef-4510-464e-bead-32b633d03f00 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:27.646018 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b58f3eef-4510-464e-bead-32b633d03f00 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:27.665360 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-b58f3eef-4510-464e-bead-32b633d03f00 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Getting quotas for project 55d21e35946242e9b067686ed5f812ac. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:09:27.669782 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-b58f3eef-4510-464e-bead-32b633d03f00 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Getting quotas for user 61ac29796a444ae88d119870a479baa9 and project 55d21e35946242e9b067686ed5f812ac. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:09:27.680788 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-b58f3eef-4510-464e-bead-32b633d03f00 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Going to run 1 instances... {{(pid=100984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:09:27.683304 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-b58f3eef-4510-464e-bead-32b633d03f00 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5be36fdc-2baa-4efd-b830-5a5c3fd7beba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:09:27.727682 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-03af7450-d68a-4591-9d72-f145110f4cdd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:27.735954 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-03af7450-d68a-4591-9d72-f145110f4cdd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.253325 Dec 14 10:09:27.736857 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 88/201] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:27 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:27.758837 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-b58f3eef-4510-464e-bead-32b633d03f00 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876337 Dec 14 10:09:27.759417 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 114/202] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Dec 14 10:09:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 10:09:27.770174 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-ced08aed-373e-409d-a6b1-32e5a51cbd5b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:27.770566 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-ced08aed-373e-409d-a6b1-32e5a51cbd5b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:27.848273 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-ced08aed-373e-409d-a6b1-32e5a51cbd5b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:27.855671 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-ced08aed-373e-409d-a6b1-32e5a51cbd5b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1218 microversion: 2.1 time: 0.090015 Dec 14 10:09:27.856247 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 89/203] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:27 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:27.894196 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-7099723d-01cb-49d2-af5a-08685b7a1188 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:27.895282 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-7099723d-01cb-49d2-af5a-08685b7a1188 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:27.904191 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7099723d-01cb-49d2-af5a-08685b7a1188 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:27.904746 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7099723d-01cb-49d2-af5a-08685b7a1188 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:27.905590 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7099723d-01cb-49d2-af5a-08685b7a1188 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:27.906115 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7099723d-01cb-49d2-af5a-08685b7a1188 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:28.112152 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-5dab286e-64b9-4efc-8c11-3cded42eb2f2 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:28.112152 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-5dab286e-64b9-4efc-8c11-3cded42eb2f2 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:28.135286 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5dab286e-64b9-4efc-8c11-3cded42eb2f2 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:28.135732 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5dab286e-64b9-4efc-8c11-3cded42eb2f2 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:28.136539 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5dab286e-64b9-4efc-8c11-3cded42eb2f2 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:28.136946 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5dab286e-64b9-4efc-8c11-3cded42eb2f2 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:28.260581 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-5dab286e-64b9-4efc-8c11-3cded42eb2f2 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:28.269727 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-5dab286e-64b9-4efc-8c11-3cded42eb2f2 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1214 microversion: 2.1 time: 0.167078 Dec 14 10:09:28.270255 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 90/204] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:28 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1214 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:28.753056 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-4750868e-c577-4853-8ae3-7d8ba3b62ba1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:28.753734 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-4750868e-c577-4853-8ae3-7d8ba3b62ba1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:28.762011 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4750868e-c577-4853-8ae3-7d8ba3b62ba1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:28.762458 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4750868e-c577-4853-8ae3-7d8ba3b62ba1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:28.763229 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4750868e-c577-4853-8ae3-7d8ba3b62ba1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:28.763644 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4750868e-c577-4853-8ae3-7d8ba3b62ba1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:28.962472 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-4750868e-c577-4853-8ae3-7d8ba3b62ba1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:28.971291 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-4750868e-c577-4853-8ae3-7d8ba3b62ba1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.222517 Dec 14 10:09:28.971858 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 91/205] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:28 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:28.975982 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-ed732147-f81d-4fbe-a307-3b3ea862a7f8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:28.976586 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-ed732147-f81d-4fbe-a307-3b3ea862a7f8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:28.983464 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ed732147-f81d-4fbe-a307-3b3ea862a7f8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:28.983910 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ed732147-f81d-4fbe-a307-3b3ea862a7f8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:28.984695 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ed732147-f81d-4fbe-a307-3b3ea862a7f8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:28.985131 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ed732147-f81d-4fbe-a307-3b3ea862a7f8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:29.095200 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-ed732147-f81d-4fbe-a307-3b3ea862a7f8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:29.103186 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-ed732147-f81d-4fbe-a307-3b3ea862a7f8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1222 microversion: 2.1 time: 0.130389 Dec 14 10:09:29.103747 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 92/206] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:28 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1222 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:29.287789 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-edbe9427-afe0-4588-bc50-c3b6b0fa0a30 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:29.288506 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-edbe9427-afe0-4588-bc50-c3b6b0fa0a30 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:29.297139 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-edbe9427-afe0-4588-bc50-c3b6b0fa0a30 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:29.297581 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-edbe9427-afe0-4588-bc50-c3b6b0fa0a30 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:29.298417 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-edbe9427-afe0-4588-bc50-c3b6b0fa0a30 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:29.298839 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-edbe9427-afe0-4588-bc50-c3b6b0fa0a30 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:29.411615 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-edbe9427-afe0-4588-bc50-c3b6b0fa0a30 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:29.419538 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-edbe9427-afe0-4588-bc50-c3b6b0fa0a30 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1214 microversion: 2.1 time: 0.136152 Dec 14 10:09:29.420114 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 93/207] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:29 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:29.988417 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-03703c1f-f506-460a-894f-2b97f31f8cf8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:29.989186 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-03703c1f-f506-460a-894f-2b97f31f8cf8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:29.996415 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-03703c1f-f506-460a-894f-2b97f31f8cf8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:29.996947 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-03703c1f-f506-460a-894f-2b97f31f8cf8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:29.997773 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-03703c1f-f506-460a-894f-2b97f31f8cf8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:29.998295 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-03703c1f-f506-460a-894f-2b97f31f8cf8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:30.264567 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-03703c1f-f506-460a-894f-2b97f31f8cf8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:30.273683 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-03703c1f-f506-460a-894f-2b97f31f8cf8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.289445 Dec 14 10:09:30.274298 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 94/208] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:29 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:30.278701 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c84782c7-1b19-40a8-aff2-9629347f5d83 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:30.279304 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c84782c7-1b19-40a8-aff2-9629347f5d83 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:30.288300 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c84782c7-1b19-40a8-aff2-9629347f5d83 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:30.288610 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c84782c7-1b19-40a8-aff2-9629347f5d83 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:30.289406 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c84782c7-1b19-40a8-aff2-9629347f5d83 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:30.289833 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c84782c7-1b19-40a8-aff2-9629347f5d83 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:30.541455 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-c84782c7-1b19-40a8-aff2-9629347f5d83 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:30.549816 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c84782c7-1b19-40a8-aff2-9629347f5d83 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1222 microversion: 2.1 time: 0.274316 Dec 14 10:09:30.550403 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 95/209] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:30 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1222 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:30.554540 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-be6ae873-1e02-4a6c-abaa-4041b6657962 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:30.555144 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-be6ae873-1e02-4a6c-abaa-4041b6657962 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:30.561818 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-be6ae873-1e02-4a6c-abaa-4041b6657962 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:30.562307 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-be6ae873-1e02-4a6c-abaa-4041b6657962 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:30.563581 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-be6ae873-1e02-4a6c-abaa-4041b6657962 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:30.564027 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-be6ae873-1e02-4a6c-abaa-4041b6657962 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:30.679464 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-be6ae873-1e02-4a6c-abaa-4041b6657962 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:30.687643 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-be6ae873-1e02-4a6c-abaa-4041b6657962 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1214 microversion: 2.1 time: 0.136183 Dec 14 10:09:30.689471 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 96/210] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:30 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:30.721470 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-7099723d-01cb-49d2-af5a-08685b7a1188 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 22969 microversion: 2.1 time: 2.832904 Dec 14 10:09:30.722747 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 115/211] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:27 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 22969 bytes in 2835 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:09:31.292453 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-74db79c9-2eeb-466b-962a-0d5c2ea0c246 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:31.293327 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-74db79c9-2eeb-466b-962a-0d5c2ea0c246 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:31.300980 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-74db79c9-2eeb-466b-962a-0d5c2ea0c246 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:31.301519 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-74db79c9-2eeb-466b-962a-0d5c2ea0c246 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:31.302400 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-74db79c9-2eeb-466b-962a-0d5c2ea0c246 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:31.302893 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-74db79c9-2eeb-466b-962a-0d5c2ea0c246 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:31.571671 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-fdc133ec-6ef2-42a7-a4b2-4f4a74d92709 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:31.572365 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-fdc133ec-6ef2-42a7-a4b2-4f4a74d92709 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:31.583535 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fdc133ec-6ef2-42a7-a4b2-4f4a74d92709 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:31.584067 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fdc133ec-6ef2-42a7-a4b2-4f4a74d92709 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:31.584949 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fdc133ec-6ef2-42a7-a4b2-4f4a74d92709 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:31.585374 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fdc133ec-6ef2-42a7-a4b2-4f4a74d92709 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:31.697540 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-74db79c9-2eeb-466b-962a-0d5c2ea0c246 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:31.710547 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-74db79c9-2eeb-466b-962a-0d5c2ea0c246 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.422560 Dec 14 10:09:31.711329 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 97/212] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:31 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:31.729491 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-305a85ff-51c8-4d0f-bf03-79abf5ae6f1b tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:31.730434 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-305a85ff-51c8-4d0f-bf03-79abf5ae6f1b tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:31.740833 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-305a85ff-51c8-4d0f-bf03-79abf5ae6f1b tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:31.741839 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-305a85ff-51c8-4d0f-bf03-79abf5ae6f1b tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:31.743872 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-305a85ff-51c8-4d0f-bf03-79abf5ae6f1b tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:31.744516 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-305a85ff-51c8-4d0f-bf03-79abf5ae6f1b tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:31.844427 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-fdc133ec-6ef2-42a7-a4b2-4f4a74d92709 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:31.860921 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-fdc133ec-6ef2-42a7-a4b2-4f4a74d92709 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1270 microversion: 2.1 time: 0.293221 Dec 14 10:09:31.862145 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 116/213] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:31 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1270 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:31.867164 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-cd35cdbf-8093-4da3-be7a-49a2fe9dea14 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:31.868363 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-cd35cdbf-8093-4da3-be7a-49a2fe9dea14 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:31.878275 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cd35cdbf-8093-4da3-be7a-49a2fe9dea14 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:31.878937 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cd35cdbf-8093-4da3-be7a-49a2fe9dea14 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:31.879927 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cd35cdbf-8093-4da3-be7a-49a2fe9dea14 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:31.880535 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cd35cdbf-8093-4da3-be7a-49a2fe9dea14 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:32.018480 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-305a85ff-51c8-4d0f-bf03-79abf5ae6f1b tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:32.031921 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-cd35cdbf-8093-4da3-be7a-49a2fe9dea14 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 23791 microversion: 2.1 time: 0.167911 Dec 14 10:09:32.033112 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-305a85ff-51c8-4d0f-bf03-79abf5ae6f1b tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1276 microversion: 2.1 time: 0.317919 Dec 14 10:09:32.037546 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 117/214] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:31 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 23791 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:09:32.045125 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 98/215] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:31 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1276 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:32.728655 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-999be2c0-b0d2-4817-b93a-71fff5c0b2eb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:32.729349 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-999be2c0-b0d2-4817-b93a-71fff5c0b2eb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:32.737703 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-999be2c0-b0d2-4817-b93a-71fff5c0b2eb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:32.738179 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-999be2c0-b0d2-4817-b93a-71fff5c0b2eb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:32.738951 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-999be2c0-b0d2-4817-b93a-71fff5c0b2eb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:32.739380 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-999be2c0-b0d2-4817-b93a-71fff5c0b2eb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:32.878679 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a1fb9f41-5387-413d-b5a4-48a82b6d0c58 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:32.879930 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a1fb9f41-5387-413d-b5a4-48a82b6d0c58 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:32.887439 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a1fb9f41-5387-413d-b5a4-48a82b6d0c58 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:32.887886 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a1fb9f41-5387-413d-b5a4-48a82b6d0c58 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:32.888660 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a1fb9f41-5387-413d-b5a4-48a82b6d0c58 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:32.889095 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a1fb9f41-5387-413d-b5a4-48a82b6d0c58 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:33.193096 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-999be2c0-b0d2-4817-b93a-71fff5c0b2eb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:33.201225 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-999be2c0-b0d2-4817-b93a-71fff5c0b2eb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.476639 Dec 14 10:09:33.206047 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 118/216] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:32 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:33.208152 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e78b10f3-fb5d-409f-b84a-1cfd70a8097a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:33.209109 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e78b10f3-fb5d-409f-b84a-1cfd70a8097a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:33.217528 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e78b10f3-fb5d-409f-b84a-1cfd70a8097a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:33.218002 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e78b10f3-fb5d-409f-b84a-1cfd70a8097a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:33.219650 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e78b10f3-fb5d-409f-b84a-1cfd70a8097a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:33.220175 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e78b10f3-fb5d-409f-b84a-1cfd70a8097a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:33.229050 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-a1fb9f41-5387-413d-b5a4-48a82b6d0c58 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:33.238576 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a1fb9f41-5387-413d-b5a4-48a82b6d0c58 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1318 microversion: 2.1 time: 0.364120 Dec 14 10:09:33.247435 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 99/217] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:32 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:33.247435 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f463c815-384e-4395-b786-379480b34b62 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:33.247435 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f463c815-384e-4395-b786-379480b34b62 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:33.251667 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f463c815-384e-4395-b786-379480b34b62 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:33.252122 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f463c815-384e-4395-b786-379480b34b62 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:33.253048 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f463c815-384e-4395-b786-379480b34b62 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:33.253483 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f463c815-384e-4395-b786-379480b34b62 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:33.869475 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f463c815-384e-4395-b786-379480b34b62 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:33.877944 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f463c815-384e-4395-b786-379480b34b62 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1318 microversion: 2.1 time: 0.637600 Dec 14 10:09:33.878519 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 100/218] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:33 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1318 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:33.882883 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-29cb7d9d-4d48-488c-8193-6444b4546712 req-20ecdd7f-a0bd-44e5-bab0-ea4957fe51c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db6ba6ce-0853-4c2d-9cdd-489058bb57df", "tag": "9d76f03f-87f4-41ec-ad81-30ce3cc98300"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:33.884425 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:09:33.884425 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:09:33.892864 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-29cb7d9d-4d48-488c-8193-6444b4546712 req-20ecdd7f-a0bd-44e5-bab0-ea4957fe51c2 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:33.893338 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-29cb7d9d-4d48-488c-8193-6444b4546712 req-20ecdd7f-a0bd-44e5-bab0-ea4957fe51c2 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:33.910032 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-29cb7d9d-4d48-488c-8193-6444b4546712 req-20ecdd7f-a0bd-44e5-bab0-ea4957fe51c2 service nova] Creating event network-changed:9d76f03f-87f4-41ec-ad81-30ce3cc98300 for instance db6ba6ce-0853-4c2d-9cdd-489058bb57df on hv-cinder-81888 Dec 14 10:09:33.914863 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-29cb7d9d-4d48-488c-8193-6444b4546712 req-20ecdd7f-a0bd-44e5-bab0-ea4957fe51c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035268 Dec 14 10:09:33.915438 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 101/219] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:09:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:09:34.223486 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c2111bf5-16d3-4680-8da7-e16ae3e0eb0d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:34.224239 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c2111bf5-16d3-4680-8da7-e16ae3e0eb0d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:34.231829 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c2111bf5-16d3-4680-8da7-e16ae3e0eb0d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:34.232277 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c2111bf5-16d3-4680-8da7-e16ae3e0eb0d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:34.233052 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c2111bf5-16d3-4680-8da7-e16ae3e0eb0d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:34.233485 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c2111bf5-16d3-4680-8da7-e16ae3e0eb0d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:34.429748 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-c2111bf5-16d3-4680-8da7-e16ae3e0eb0d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:34.440767 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c2111bf5-16d3-4680-8da7-e16ae3e0eb0d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.221035 Dec 14 10:09:34.441343 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 102/220] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:34 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:34.445774 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c32db6f9-28d5-4c81-b180-f7923fd7e462 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:34.446402 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c32db6f9-28d5-4c81-b180-f7923fd7e462 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:34.453048 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c32db6f9-28d5-4c81-b180-f7923fd7e462 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:34.453514 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c32db6f9-28d5-4c81-b180-f7923fd7e462 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:34.454311 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c32db6f9-28d5-4c81-b180-f7923fd7e462 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:34.454754 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c32db6f9-28d5-4c81-b180-f7923fd7e462 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:34.657935 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-c32db6f9-28d5-4c81-b180-f7923fd7e462 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:34.665895 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c32db6f9-28d5-4c81-b180-f7923fd7e462 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1318 microversion: 2.1 time: 0.223619 Dec 14 10:09:34.666476 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 103/221] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:34 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:34.895140 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-08c6a9e3-05e5-45be-bd08-a14ad94913af tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:34.895771 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-08c6a9e3-05e5-45be-bd08-a14ad94913af tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:34.903182 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-08c6a9e3-05e5-45be-bd08-a14ad94913af tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:34.903624 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-08c6a9e3-05e5-45be-bd08-a14ad94913af tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:34.904373 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-08c6a9e3-05e5-45be-bd08-a14ad94913af tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:34.904799 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-08c6a9e3-05e5-45be-bd08-a14ad94913af tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:35.105878 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-08c6a9e3-05e5-45be-bd08-a14ad94913af tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:35.114029 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-08c6a9e3-05e5-45be-bd08-a14ad94913af tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1318 microversion: 2.1 time: 0.223104 Dec 14 10:09:35.114578 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 104/222] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:34 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:35.458257 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-462babb2-5fef-4d19-b0a2-e421321df471 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:35.458982 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-462babb2-5fef-4d19-b0a2-e421321df471 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:35.466074 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-462babb2-5fef-4d19-b0a2-e421321df471 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:35.466516 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-462babb2-5fef-4d19-b0a2-e421321df471 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:35.467309 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-462babb2-5fef-4d19-b0a2-e421321df471 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:35.467745 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-462babb2-5fef-4d19-b0a2-e421321df471 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:35.680031 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-462babb2-5fef-4d19-b0a2-e421321df471 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:35.688559 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-462babb2-5fef-4d19-b0a2-e421321df471 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.233998 Dec 14 10:09:35.689314 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 105/223] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:35 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:35.693444 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-4e229156-4a5f-4093-950b-821790119ab5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:35.694087 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-4e229156-4a5f-4093-950b-821790119ab5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:35.701032 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4e229156-4a5f-4093-950b-821790119ab5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:35.701483 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4e229156-4a5f-4093-950b-821790119ab5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:35.702272 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4e229156-4a5f-4093-950b-821790119ab5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:35.702705 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4e229156-4a5f-4093-950b-821790119ab5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:35.902990 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-4e229156-4a5f-4093-950b-821790119ab5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:35.909786 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-4e229156-4a5f-4093-950b-821790119ab5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1318 microversion: 2.1 time: 0.219680 Dec 14 10:09:35.910361 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 106/224] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:35 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:36.132547 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-d3bd3c4b-a7fa-45e0-9ea6-f57b2395ec69 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:36.133165 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-d3bd3c4b-a7fa-45e0-9ea6-f57b2395ec69 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:36.140895 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d3bd3c4b-a7fa-45e0-9ea6-f57b2395ec69 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:36.141018 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d3bd3c4b-a7fa-45e0-9ea6-f57b2395ec69 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:36.141719 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d3bd3c4b-a7fa-45e0-9ea6-f57b2395ec69 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:36.142198 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d3bd3c4b-a7fa-45e0-9ea6-f57b2395ec69 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:36.338142 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-d3bd3c4b-a7fa-45e0-9ea6-f57b2395ec69 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:36.346671 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-d3bd3c4b-a7fa-45e0-9ea6-f57b2395ec69 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1318 microversion: 2.1 time: 0.217887 Dec 14 10:09:36.347222 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 107/225] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:36 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:36.544148 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e78b10f3-fb5d-409f-b84a-1cfd70a8097a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 26491 microversion: 2.1 time: 3.339831 Dec 14 10:09:36.548069 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 119/226] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:33 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 26491 bytes in 3343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:09:36.707736 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c1098e4d-6c6e-4d5b-86f1-d2f40401c66d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:36.720569 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c1098e4d-6c6e-4d5b-86f1-d2f40401c66d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:36.729770 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c1098e4d-6c6e-4d5b-86f1-d2f40401c66d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:36.731960 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c1098e4d-6c6e-4d5b-86f1-d2f40401c66d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:36.732961 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c1098e4d-6c6e-4d5b-86f1-d2f40401c66d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:36.734705 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c1098e4d-6c6e-4d5b-86f1-d2f40401c66d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:36.929898 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4fd5cc95-f479-4ed1-a3ee-2888048149b8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:36.930914 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4fd5cc95-f479-4ed1-a3ee-2888048149b8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:36.942806 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4fd5cc95-f479-4ed1-a3ee-2888048149b8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:36.943254 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4fd5cc95-f479-4ed1-a3ee-2888048149b8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:36.944095 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4fd5cc95-f479-4ed1-a3ee-2888048149b8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:36.944582 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4fd5cc95-f479-4ed1-a3ee-2888048149b8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:37.067221 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-c1098e4d-6c6e-4d5b-86f1-d2f40401c66d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:37.084470 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c1098e4d-6c6e-4d5b-86f1-d2f40401c66d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.383161 Dec 14 10:09:37.085053 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 108/227] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:36 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:37.362955 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-dbd89dc7-a0a0-4d1d-b22a-c2e1912fe75a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:37.363860 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-dbd89dc7-a0a0-4d1d-b22a-c2e1912fe75a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:37.371620 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dbd89dc7-a0a0-4d1d-b22a-c2e1912fe75a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:37.372243 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dbd89dc7-a0a0-4d1d-b22a-c2e1912fe75a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:37.373885 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dbd89dc7-a0a0-4d1d-b22a-c2e1912fe75a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:37.374615 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dbd89dc7-a0a0-4d1d-b22a-c2e1912fe75a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:37.488257 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4fd5cc95-f479-4ed1-a3ee-2888048149b8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:37.497367 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4fd5cc95-f479-4ed1-a3ee-2888048149b8 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1318 microversion: 2.1 time: 0.573399 Dec 14 10:09:37.498044 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 120/228] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:36 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1318 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:37.555739 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e2753c61-11c2-4dfa-b7a0-736cc88809a2 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:37.557315 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e2753c61-11c2-4dfa-b7a0-736cc88809a2 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:37.568862 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e2753c61-11c2-4dfa-b7a0-736cc88809a2 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:37.569404 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e2753c61-11c2-4dfa-b7a0-736cc88809a2 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:37.570300 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e2753c61-11c2-4dfa-b7a0-736cc88809a2 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:37.571539 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e2753c61-11c2-4dfa-b7a0-736cc88809a2 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:37.735687 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e2753c61-11c2-4dfa-b7a0-736cc88809a2 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 26995 microversion: 2.1 time: 0.182519 Dec 14 10:09:37.735926 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-dbd89dc7-a0a0-4d1d-b22a-c2e1912fe75a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:37.736842 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 121/229] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:37 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 26995 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:09:37.746672 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-dbd89dc7-a0a0-4d1d-b22a-c2e1912fe75a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1318 microversion: 2.1 time: 0.387248 Dec 14 10:09:37.747184 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 109/230] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:37 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:37.755553 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-6e2be4fc-ca0d-47d2-af35-62a71680a5c6 req-2944de2d-d7e2-41bf-907b-f34c26fa2024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e60e3bf-4317-4c75-87fd-d9dd68489214", "tag": "385495e2-0211-4c85-9b90-9b279f481c48"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:37.762420 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:09:37.762420 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:09:37.778467 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-6e2be4fc-ca0d-47d2-af35-62a71680a5c6 req-2944de2d-d7e2-41bf-907b-f34c26fa2024 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:37.778929 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-6e2be4fc-ca0d-47d2-af35-62a71680a5c6 req-2944de2d-d7e2-41bf-907b-f34c26fa2024 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:37.814966 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-6e2be4fc-ca0d-47d2-af35-62a71680a5c6 req-2944de2d-d7e2-41bf-907b-f34c26fa2024 service nova] Creating event network-changed:385495e2-0211-4c85-9b90-9b279f481c48 for instance 9e60e3bf-4317-4c75-87fd-d9dd68489214 on hv-cinder-81888 Dec 14 10:09:37.825752 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-6e2be4fc-ca0d-47d2-af35-62a71680a5c6 req-2944de2d-d7e2-41bf-907b-f34c26fa2024 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083735 Dec 14 10:09:37.826771 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 122/231] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:09:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:09:38.100673 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-2f5d9bce-b612-4a70-b489-923057d39ed8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:38.101111 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-2f5d9bce-b612-4a70-b489-923057d39ed8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:38.108405 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2f5d9bce-b612-4a70-b489-923057d39ed8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:38.109052 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2f5d9bce-b612-4a70-b489-923057d39ed8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:38.110580 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2f5d9bce-b612-4a70-b489-923057d39ed8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:38.111171 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2f5d9bce-b612-4a70-b489-923057d39ed8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:38.333271 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-2f5d9bce-b612-4a70-b489-923057d39ed8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:38.347584 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-2f5d9bce-b612-4a70-b489-923057d39ed8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.250749 Dec 14 10:09:38.348306 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 110/232] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:38 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:38.515412 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-fddeac8b-ad80-4160-9111-29676dae829a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:38.516544 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-fddeac8b-ad80-4160-9111-29676dae829a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:38.524244 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fddeac8b-ad80-4160-9111-29676dae829a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:38.525136 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fddeac8b-ad80-4160-9111-29676dae829a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:38.526081 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fddeac8b-ad80-4160-9111-29676dae829a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:38.526708 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fddeac8b-ad80-4160-9111-29676dae829a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:38.750295 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-51421925-483d-4ee3-b88e-8a2b94642d12 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:38.751811 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-51421925-483d-4ee3-b88e-8a2b94642d12 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:38.762935 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-51421925-483d-4ee3-b88e-8a2b94642d12 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:38.763498 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-51421925-483d-4ee3-b88e-8a2b94642d12 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:38.764402 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-51421925-483d-4ee3-b88e-8a2b94642d12 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:38.764934 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-51421925-483d-4ee3-b88e-8a2b94642d12 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:38.878817 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-fddeac8b-ad80-4160-9111-29676dae829a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:38.887803 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-fddeac8b-ad80-4160-9111-29676dae829a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1318 microversion: 2.1 time: 0.376384 Dec 14 10:09:38.888942 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 123/233] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:38 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:38.905343 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-429a4d87-785c-48fc-9b80-38b7268f9160 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:38.906152 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-429a4d87-785c-48fc-9b80-38b7268f9160 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:38.914235 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-429a4d87-785c-48fc-9b80-38b7268f9160 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:38.914909 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-429a4d87-785c-48fc-9b80-38b7268f9160 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:38.916094 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-429a4d87-785c-48fc-9b80-38b7268f9160 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:38.916599 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-429a4d87-785c-48fc-9b80-38b7268f9160 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:38.931929 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-51421925-483d-4ee3-b88e-8a2b94642d12 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 27465 microversion: 2.1 time: 0.187475 Dec 14 10:09:38.933120 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 111/234] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:38 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 27465 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:09:39.284579 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-429a4d87-785c-48fc-9b80-38b7268f9160 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:39.295353 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-429a4d87-785c-48fc-9b80-38b7268f9160 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1318 microversion: 2.1 time: 0.405029 Dec 14 10:09:39.296512 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 124/235] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:38 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:39.365314 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-7b453828-2cd1-41da-875a-44a62c85e81f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:39.366120 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-7b453828-2cd1-41da-875a-44a62c85e81f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:39.374060 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7b453828-2cd1-41da-875a-44a62c85e81f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:39.374586 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7b453828-2cd1-41da-875a-44a62c85e81f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:39.376300 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7b453828-2cd1-41da-875a-44a62c85e81f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:39.376834 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7b453828-2cd1-41da-875a-44a62c85e81f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:39.593343 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-7b453828-2cd1-41da-875a-44a62c85e81f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:39.602208 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-7b453828-2cd1-41da-875a-44a62c85e81f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.241224 Dec 14 10:09:39.602778 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 112/236] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:39 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:39.907802 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-470b56c3-a5c8-493e-86a2-da94f2e2f3b2 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:39.908476 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-470b56c3-a5c8-493e-86a2-da94f2e2f3b2 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:39.916025 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-470b56c3-a5c8-493e-86a2-da94f2e2f3b2 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:39.916466 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-470b56c3-a5c8-493e-86a2-da94f2e2f3b2 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:39.917221 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-470b56c3-a5c8-493e-86a2-da94f2e2f3b2 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:39.917671 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-470b56c3-a5c8-493e-86a2-da94f2e2f3b2 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:39.945892 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-2cc17080-098c-4f06-b471-31257c4db495 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:39.946977 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-2cc17080-098c-4f06-b471-31257c4db495 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:39.954427 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2cc17080-098c-4f06-b471-31257c4db495 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:39.954988 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2cc17080-098c-4f06-b471-31257c4db495 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:39.955860 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2cc17080-098c-4f06-b471-31257c4db495 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:39.956393 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2cc17080-098c-4f06-b471-31257c4db495 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:40.144521 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-470b56c3-a5c8-493e-86a2-da94f2e2f3b2 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:40.152980 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-470b56c3-a5c8-493e-86a2-da94f2e2f3b2 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1318 microversion: 2.1 time: 0.249933 Dec 14 10:09:40.153546 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 125/237] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:39 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:40.313044 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-97808fdb-9199-440d-8aaf-1723cc94d22a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:40.314255 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-97808fdb-9199-440d-8aaf-1723cc94d22a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:40.321488 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-97808fdb-9199-440d-8aaf-1723cc94d22a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:40.321932 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-97808fdb-9199-440d-8aaf-1723cc94d22a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:40.322738 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-97808fdb-9199-440d-8aaf-1723cc94d22a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:40.323200 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-97808fdb-9199-440d-8aaf-1723cc94d22a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:40.520738 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-97808fdb-9199-440d-8aaf-1723cc94d22a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:40.529078 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-97808fdb-9199-440d-8aaf-1723cc94d22a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1318 microversion: 2.1 time: 0.220384 Dec 14 10:09:40.529640 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 126/238] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:40 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:40.623289 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8eae89fc-8581-4f80-b976-ecb44b59bbb2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:40.624267 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-8eae89fc-8581-4f80-b976-ecb44b59bbb2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:40.632753 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8eae89fc-8581-4f80-b976-ecb44b59bbb2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:40.633386 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8eae89fc-8581-4f80-b976-ecb44b59bbb2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:40.634301 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8eae89fc-8581-4f80-b976-ecb44b59bbb2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:40.635724 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8eae89fc-8581-4f80-b976-ecb44b59bbb2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:40.838560 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-8eae89fc-8581-4f80-b976-ecb44b59bbb2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:40.847951 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8eae89fc-8581-4f80-b976-ecb44b59bbb2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.229366 Dec 14 10:09:40.848613 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 127/239] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:40 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:41.169772 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f419b5d0-bc9c-4e59-86bf-5aaf4cab81d4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:41.170416 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f419b5d0-bc9c-4e59-86bf-5aaf4cab81d4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:41.178058 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f419b5d0-bc9c-4e59-86bf-5aaf4cab81d4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:41.178506 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f419b5d0-bc9c-4e59-86bf-5aaf4cab81d4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:41.179268 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f419b5d0-bc9c-4e59-86bf-5aaf4cab81d4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:41.179701 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f419b5d0-bc9c-4e59-86bf-5aaf4cab81d4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:41.370561 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-f419b5d0-bc9c-4e59-86bf-5aaf4cab81d4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:41.379122 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f419b5d0-bc9c-4e59-86bf-5aaf4cab81d4 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1318 microversion: 2.1 time: 0.213019 Dec 14 10:09:41.379680 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 128/240] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:41 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:41.545834 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5cb6b295-51a9-4294-a2da-a8f089031b06 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:41.546464 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5cb6b295-51a9-4294-a2da-a8f089031b06 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:41.553821 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5cb6b295-51a9-4294-a2da-a8f089031b06 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:41.554285 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5cb6b295-51a9-4294-a2da-a8f089031b06 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:41.555074 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5cb6b295-51a9-4294-a2da-a8f089031b06 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:41.555495 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5cb6b295-51a9-4294-a2da-a8f089031b06 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:41.747819 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5cb6b295-51a9-4294-a2da-a8f089031b06 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:41.755963 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5cb6b295-51a9-4294-a2da-a8f089031b06 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1318 microversion: 2.1 time: 0.213565 Dec 14 10:09:41.756516 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 129/241] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:41 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:41.864789 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-de08bb16-3ab6-477e-b481-e4ce39a4e76b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:41.865392 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-de08bb16-3ab6-477e-b481-e4ce39a4e76b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:41.872520 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-de08bb16-3ab6-477e-b481-e4ce39a4e76b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:41.872959 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-de08bb16-3ab6-477e-b481-e4ce39a4e76b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:41.873719 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-de08bb16-3ab6-477e-b481-e4ce39a4e76b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:41.874258 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-de08bb16-3ab6-477e-b481-e4ce39a4e76b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:42.072605 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-de08bb16-3ab6-477e-b481-e4ce39a4e76b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:42.080894 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-de08bb16-3ab6-477e-b481-e4ce39a4e76b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.219662 Dec 14 10:09:42.081452 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 130/242] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:41 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:42.396290 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f62b7d12-724e-4050-83dc-c47b30715024 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:42.396917 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f62b7d12-724e-4050-83dc-c47b30715024 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:42.404369 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f62b7d12-724e-4050-83dc-c47b30715024 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:42.404806 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f62b7d12-724e-4050-83dc-c47b30715024 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:42.405548 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f62b7d12-724e-4050-83dc-c47b30715024 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:42.406602 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f62b7d12-724e-4050-83dc-c47b30715024 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:42.595818 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-f62b7d12-724e-4050-83dc-c47b30715024 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:42.603768 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f62b7d12-724e-4050-83dc-c47b30715024 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1318 microversion: 2.1 time: 0.211341 Dec 14 10:09:42.604332 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 131/243] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:42 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:42.772303 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e71893be-23ee-471d-9f01-c4563d290af3 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:42.772907 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e71893be-23ee-471d-9f01-c4563d290af3 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:42.780230 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e71893be-23ee-471d-9f01-c4563d290af3 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:42.780707 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e71893be-23ee-471d-9f01-c4563d290af3 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:42.781830 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e71893be-23ee-471d-9f01-c4563d290af3 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:42.782118 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e71893be-23ee-471d-9f01-c4563d290af3 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:43.026848 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e71893be-23ee-471d-9f01-c4563d290af3 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:43.035311 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e71893be-23ee-471d-9f01-c4563d290af3 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1318 microversion: 2.1 time: 0.266651 Dec 14 10:09:43.035956 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 132/244] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:42 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:43.097890 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1e20c37f-f401-4f7c-a4fd-5f87eb5a124b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:43.098463 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1e20c37f-f401-4f7c-a4fd-5f87eb5a124b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:43.105599 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1e20c37f-f401-4f7c-a4fd-5f87eb5a124b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:43.106083 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1e20c37f-f401-4f7c-a4fd-5f87eb5a124b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:43.106848 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1e20c37f-f401-4f7c-a4fd-5f87eb5a124b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:43.107281 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1e20c37f-f401-4f7c-a4fd-5f87eb5a124b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:43.307717 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1e20c37f-f401-4f7c-a4fd-5f87eb5a124b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:43.316471 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1e20c37f-f401-4f7c-a4fd-5f87eb5a124b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.222719 Dec 14 10:09:43.317022 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 133/245] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:43 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:43.603435 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-2cc17080-098c-4f06-b471-31257c4db495 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 27810 microversion: 2.1 time: 3.663341 Dec 14 10:09:43.607301 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 113/246] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:39 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 27810 bytes in 3665 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:09:43.620332 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e548d970-840d-41be-9537-3300042a98d0 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:43.620940 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e548d970-840d-41be-9537-3300042a98d0 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:43.629070 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e548d970-840d-41be-9537-3300042a98d0 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:43.629505 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e548d970-840d-41be-9537-3300042a98d0 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:43.630313 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e548d970-840d-41be-9537-3300042a98d0 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:43.630763 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e548d970-840d-41be-9537-3300042a98d0 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:43.834938 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e548d970-840d-41be-9537-3300042a98d0 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:43.845722 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e548d970-840d-41be-9537-3300042a98d0 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1318 microversion: 2.1 time: 0.229035 Dec 14 10:09:43.846315 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 134/247] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:43 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:44.052237 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6d1f8320-bff3-48df-92d4-506d9cb5574f tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:44.053201 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6d1f8320-bff3-48df-92d4-506d9cb5574f tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:44.060897 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6d1f8320-bff3-48df-92d4-506d9cb5574f tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:44.061332 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6d1f8320-bff3-48df-92d4-506d9cb5574f tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:44.062131 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6d1f8320-bff3-48df-92d4-506d9cb5574f tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:44.062610 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6d1f8320-bff3-48df-92d4-506d9cb5574f tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:44.260443 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-6d1f8320-bff3-48df-92d4-506d9cb5574f tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:44.269453 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6d1f8320-bff3-48df-92d4-506d9cb5574f tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1318 microversion: 2.1 time: 0.221222 Dec 14 10:09:44.270140 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 114/248] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:44 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:44.333217 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f9768685-edf7-41e1-8a49-434aa3e004f7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:44.333914 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f9768685-edf7-41e1-8a49-434aa3e004f7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:44.347266 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f9768685-edf7-41e1-8a49-434aa3e004f7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:44.347786 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f9768685-edf7-41e1-8a49-434aa3e004f7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:44.348625 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f9768685-edf7-41e1-8a49-434aa3e004f7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:44.349129 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f9768685-edf7-41e1-8a49-434aa3e004f7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:44.554470 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-f9768685-edf7-41e1-8a49-434aa3e004f7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:44.562985 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f9768685-edf7-41e1-8a49-434aa3e004f7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.233156 Dec 14 10:09:44.563747 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 135/249] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:44 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:44.614992 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-036679df-fbfd-449b-baeb-fce6e7a5a51c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:44.615821 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-036679df-fbfd-449b-baeb-fce6e7a5a51c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:44.622851 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-036679df-fbfd-449b-baeb-fce6e7a5a51c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:44.623340 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-036679df-fbfd-449b-baeb-fce6e7a5a51c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:44.624099 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-036679df-fbfd-449b-baeb-fce6e7a5a51c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:44.625110 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-036679df-fbfd-449b-baeb-fce6e7a5a51c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:44.862979 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8ea1d3ed-9970-486b-b29c-0bbdffa9c1a7 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:44.863722 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-8ea1d3ed-9970-486b-b29c-0bbdffa9c1a7 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:44.871751 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8ea1d3ed-9970-486b-b29c-0bbdffa9c1a7 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:44.872126 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8ea1d3ed-9970-486b-b29c-0bbdffa9c1a7 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:44.872879 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8ea1d3ed-9970-486b-b29c-0bbdffa9c1a7 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:44.873361 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8ea1d3ed-9970-486b-b29c-0bbdffa9c1a7 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:45.086697 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-8ea1d3ed-9970-486b-b29c-0bbdffa9c1a7 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:45.095658 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8ea1d3ed-9970-486b-b29c-0bbdffa9c1a7 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1318 microversion: 2.1 time: 0.236717 Dec 14 10:09:45.096317 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 136/250] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:44 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:45.286811 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-04b13936-ab5b-488c-80b5-70345b8db110 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:45.287419 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-04b13936-ab5b-488c-80b5-70345b8db110 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:45.294631 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-04b13936-ab5b-488c-80b5-70345b8db110 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:45.295064 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-04b13936-ab5b-488c-80b5-70345b8db110 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:45.295811 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-04b13936-ab5b-488c-80b5-70345b8db110 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:45.296236 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-04b13936-ab5b-488c-80b5-70345b8db110 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:45.489673 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-04b13936-ab5b-488c-80b5-70345b8db110 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:45.497690 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-04b13936-ab5b-488c-80b5-70345b8db110 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1318 microversion: 2.1 time: 0.214500 Dec 14 10:09:45.498288 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 137/251] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:45 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:45.579869 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1df75d15-b07c-49c3-b2c3-f7b5a28b289c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:45.580472 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1df75d15-b07c-49c3-b2c3-f7b5a28b289c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:45.587473 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1df75d15-b07c-49c3-b2c3-f7b5a28b289c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:45.587918 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1df75d15-b07c-49c3-b2c3-f7b5a28b289c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:45.588678 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1df75d15-b07c-49c3-b2c3-f7b5a28b289c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:45.589109 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1df75d15-b07c-49c3-b2c3-f7b5a28b289c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:45.782813 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1df75d15-b07c-49c3-b2c3-f7b5a28b289c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:45.790683 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1df75d15-b07c-49c3-b2c3-f7b5a28b289c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.214783 Dec 14 10:09:45.791245 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 138/252] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:45 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:46.112826 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-02b655fb-88a8-436f-add0-98a7398e1c14 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:46.113441 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-02b655fb-88a8-436f-add0-98a7398e1c14 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:46.120518 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-02b655fb-88a8-436f-add0-98a7398e1c14 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:46.121010 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-02b655fb-88a8-436f-add0-98a7398e1c14 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:46.121731 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-02b655fb-88a8-436f-add0-98a7398e1c14 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:46.122195 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-02b655fb-88a8-436f-add0-98a7398e1c14 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:46.319052 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-02b655fb-88a8-436f-add0-98a7398e1c14 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:46.327028 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-02b655fb-88a8-436f-add0-98a7398e1c14 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1318 microversion: 2.1 time: 0.218016 Dec 14 10:09:46.327593 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 139/253] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:46 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:46.514327 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5c54d065-e85f-4227-bb71-af261f281d70 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:46.514956 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5c54d065-e85f-4227-bb71-af261f281d70 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:46.522101 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5c54d065-e85f-4227-bb71-af261f281d70 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:46.522545 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5c54d065-e85f-4227-bb71-af261f281d70 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:46.523296 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5c54d065-e85f-4227-bb71-af261f281d70 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:46.523829 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5c54d065-e85f-4227-bb71-af261f281d70 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:46.715837 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5c54d065-e85f-4227-bb71-af261f281d70 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:46.724201 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5c54d065-e85f-4227-bb71-af261f281d70 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1318 microversion: 2.1 time: 0.213508 Dec 14 10:09:46.724756 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 140/254] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:46 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:46.807452 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f0819418-4f75-4028-b4e6-071d68fcdd3a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:46.808082 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f0819418-4f75-4028-b4e6-071d68fcdd3a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:46.816515 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f0819418-4f75-4028-b4e6-071d68fcdd3a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:46.816955 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f0819418-4f75-4028-b4e6-071d68fcdd3a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:46.817722 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f0819418-4f75-4028-b4e6-071d68fcdd3a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:46.818190 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f0819418-4f75-4028-b4e6-071d68fcdd3a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:47.008961 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-f0819418-4f75-4028-b4e6-071d68fcdd3a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:47.017419 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f0819418-4f75-4028-b4e6-071d68fcdd3a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.213408 Dec 14 10:09:47.018038 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 141/255] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:46 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:47.342976 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4178cd77-a1fb-49cd-b1f6-e4e00f7a474e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:47.343861 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4178cd77-a1fb-49cd-b1f6-e4e00f7a474e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:47.351004 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4178cd77-a1fb-49cd-b1f6-e4e00f7a474e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:47.351477 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4178cd77-a1fb-49cd-b1f6-e4e00f7a474e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:47.352228 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4178cd77-a1fb-49cd-b1f6-e4e00f7a474e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:47.352652 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4178cd77-a1fb-49cd-b1f6-e4e00f7a474e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:47.561756 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4178cd77-a1fb-49cd-b1f6-e4e00f7a474e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:47.570433 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4178cd77-a1fb-49cd-b1f6-e4e00f7a474e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1318 microversion: 2.1 time: 0.231175 Dec 14 10:09:47.571002 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 142/256] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:47 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:47.605056 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-036679df-fbfd-449b-baeb-fce6e7a5a51c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 28052 microversion: 2.1 time: 2.993684 Dec 14 10:09:47.605692 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 115/257] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:44 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 28052 bytes in 2995 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:09:47.740861 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-9c78000b-8efb-4412-94d8-839855a61478 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:47.741455 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-9c78000b-8efb-4412-94d8-839855a61478 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:47.748637 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9c78000b-8efb-4412-94d8-839855a61478 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:47.749073 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9c78000b-8efb-4412-94d8-839855a61478 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:47.750473 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9c78000b-8efb-4412-94d8-839855a61478 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:47.751040 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9c78000b-8efb-4412-94d8-839855a61478 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:47.946851 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-9c78000b-8efb-4412-94d8-839855a61478 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:47.954990 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-9c78000b-8efb-4412-94d8-839855a61478 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1318 microversion: 2.1 time: 0.217808 Dec 14 10:09:47.955545 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 143/258] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:47 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:48.035609 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a2d30598-dcf5-4800-aa31-6dec8484193e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:48.036297 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a2d30598-dcf5-4800-aa31-6dec8484193e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:48.045452 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a2d30598-dcf5-4800-aa31-6dec8484193e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:48.045900 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a2d30598-dcf5-4800-aa31-6dec8484193e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:48.047356 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a2d30598-dcf5-4800-aa31-6dec8484193e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:48.047790 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a2d30598-dcf5-4800-aa31-6dec8484193e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:48.250934 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-a2d30598-dcf5-4800-aa31-6dec8484193e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:48.259188 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a2d30598-dcf5-4800-aa31-6dec8484193e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.228251 Dec 14 10:09:48.259752 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 116/259] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:48 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:48.587924 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-67612dfb-c573-470e-bb7a-3fbc4375e428 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:48.588591 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-67612dfb-c573-470e-bb7a-3fbc4375e428 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:48.596445 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-67612dfb-c573-470e-bb7a-3fbc4375e428 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:48.596894 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-67612dfb-c573-470e-bb7a-3fbc4375e428 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:48.597664 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-67612dfb-c573-470e-bb7a-3fbc4375e428 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:48.598126 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-67612dfb-c573-470e-bb7a-3fbc4375e428 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:48.616621 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e6974712-46e6-4ca7-9edf-3accdba58394 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:48.617642 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e6974712-46e6-4ca7-9edf-3accdba58394 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:48.624877 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e6974712-46e6-4ca7-9edf-3accdba58394 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:48.625384 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e6974712-46e6-4ca7-9edf-3accdba58394 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:48.626194 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e6974712-46e6-4ca7-9edf-3accdba58394 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:48.626660 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e6974712-46e6-4ca7-9edf-3accdba58394 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:48.759871 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e6974712-46e6-4ca7-9edf-3accdba58394 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 28169 microversion: 2.1 time: 0.146800 Dec 14 10:09:48.760869 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 117/260] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:48 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 28169 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:09:48.803533 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-67612dfb-c573-470e-bb7a-3fbc4375e428 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:48.811744 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-67612dfb-c573-470e-bb7a-3fbc4375e428 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1318 microversion: 2.1 time: 0.227563 Dec 14 10:09:48.812916 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 144/261] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:48 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:48.970950 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-952f4347-5384-4a0a-9984-7609128a04da tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:48.971641 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-952f4347-5384-4a0a-9984-7609128a04da tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:48.979465 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-952f4347-5384-4a0a-9984-7609128a04da tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:48.979911 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-952f4347-5384-4a0a-9984-7609128a04da tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:48.980673 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-952f4347-5384-4a0a-9984-7609128a04da tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:48.981103 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-952f4347-5384-4a0a-9984-7609128a04da tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:49.174696 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-952f4347-5384-4a0a-9984-7609128a04da tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:49.182641 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-952f4347-5384-4a0a-9984-7609128a04da tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1318 microversion: 2.1 time: 0.215773 Dec 14 10:09:49.183192 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 118/262] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:48 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:49.276167 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c1a96b13-5db2-40fc-b966-1b2154779267 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:49.276793 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c1a96b13-5db2-40fc-b966-1b2154779267 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:49.284210 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c1a96b13-5db2-40fc-b966-1b2154779267 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:49.284844 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c1a96b13-5db2-40fc-b966-1b2154779267 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:49.285675 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c1a96b13-5db2-40fc-b966-1b2154779267 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:49.286170 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c1a96b13-5db2-40fc-b966-1b2154779267 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:49.493719 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c1a96b13-5db2-40fc-b966-1b2154779267 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:49.505344 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c1a96b13-5db2-40fc-b966-1b2154779267 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.232989 Dec 14 10:09:49.509787 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 145/263] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:49 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:49.772338 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a7a00a47-ca4a-43c2-8b5a-99c26fb34ddc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:49.773412 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a7a00a47-ca4a-43c2-8b5a-99c26fb34ddc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:49.781281 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a7a00a47-ca4a-43c2-8b5a-99c26fb34ddc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:49.781884 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a7a00a47-ca4a-43c2-8b5a-99c26fb34ddc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:49.790858 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a7a00a47-ca4a-43c2-8b5a-99c26fb34ddc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:49.791308 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a7a00a47-ca4a-43c2-8b5a-99c26fb34ddc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:49.807808 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-6553a443-7c6c-409f-a309-b0249de20c3e req-6ec6fb42-b259-4bed-85ef-4283924ed09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e60e3bf-4317-4c75-87fd-d9dd68489214", "name": "network-vif-plugged", "status": "completed", "tag": "385495e2-0211-4c85-9b90-9b279f481c48"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:49.810296 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:09:49.810296 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:09:49.819078 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-6553a443-7c6c-409f-a309-b0249de20c3e req-6ec6fb42-b259-4bed-85ef-4283924ed09e service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:49.819509 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-6553a443-7c6c-409f-a309-b0249de20c3e req-6ec6fb42-b259-4bed-85ef-4283924ed09e service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:49.837421 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-6553a443-7c6c-409f-a309-b0249de20c3e req-6ec6fb42-b259-4bed-85ef-4283924ed09e service nova] Creating event network-vif-plugged:385495e2-0211-4c85-9b90-9b279f481c48 for instance 9e60e3bf-4317-4c75-87fd-d9dd68489214 on hv-cinder-81888 Dec 14 10:09:49.843179 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-6553a443-7c6c-409f-a309-b0249de20c3e req-6ec6fb42-b259-4bed-85ef-4283924ed09e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040874 Dec 14 10:09:49.843968 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 146/264] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:09:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:09:49.850750 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a25c8a2a-60fc-40c2-b487-2a97243e572a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:49.851443 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-a25c8a2a-60fc-40c2-b487-2a97243e572a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:49.860140 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a25c8a2a-60fc-40c2-b487-2a97243e572a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:49.860998 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a25c8a2a-60fc-40c2-b487-2a97243e572a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:49.861765 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a25c8a2a-60fc-40c2-b487-2a97243e572a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:49.862219 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a25c8a2a-60fc-40c2-b487-2a97243e572a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:49.946079 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a7a00a47-ca4a-43c2-8b5a-99c26fb34ddc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 28169 microversion: 2.1 time: 0.177188 Dec 14 10:09:49.946839 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 119/265] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:49 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 28169 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:09:50.170541 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-a25c8a2a-60fc-40c2-b487-2a97243e572a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:50.183099 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a25c8a2a-60fc-40c2-b487-2a97243e572a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1318 microversion: 2.1 time: 0.337702 Dec 14 10:09:50.184986 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 147/266] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:49 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:50.202088 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-fe620555-6975-4efc-9c2e-c9b08e8074c9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:50.203559 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-fe620555-6975-4efc-9c2e-c9b08e8074c9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:50.212125 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fe620555-6975-4efc-9c2e-c9b08e8074c9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:50.212639 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fe620555-6975-4efc-9c2e-c9b08e8074c9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:50.213419 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fe620555-6975-4efc-9c2e-c9b08e8074c9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:50.214005 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fe620555-6975-4efc-9c2e-c9b08e8074c9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:50.414120 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-fe620555-6975-4efc-9c2e-c9b08e8074c9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:50.422767 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-fe620555-6975-4efc-9c2e-c9b08e8074c9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1318 microversion: 2.1 time: 0.225713 Dec 14 10:09:50.423337 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 120/267] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:50 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:50.521530 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-aaeae62e-e96e-4962-892d-162eefd17ac1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:50.522372 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-aaeae62e-e96e-4962-892d-162eefd17ac1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:50.529934 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aaeae62e-e96e-4962-892d-162eefd17ac1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:50.530514 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aaeae62e-e96e-4962-892d-162eefd17ac1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:50.531979 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aaeae62e-e96e-4962-892d-162eefd17ac1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:50.532583 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aaeae62e-e96e-4962-892d-162eefd17ac1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:50.727591 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-aaeae62e-e96e-4962-892d-162eefd17ac1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:50.735855 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-aaeae62e-e96e-4962-892d-162eefd17ac1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.218283 Dec 14 10:09:50.736414 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 148/268] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:50 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:50.958442 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-81be0862-83fc-4f20-b214-121fa0ace9e9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:50.959290 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-81be0862-83fc-4f20-b214-121fa0ace9e9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:50.966398 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-81be0862-83fc-4f20-b214-121fa0ace9e9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:50.966849 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-81be0862-83fc-4f20-b214-121fa0ace9e9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:50.967625 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-81be0862-83fc-4f20-b214-121fa0ace9e9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:50.968057 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-81be0862-83fc-4f20-b214-121fa0ace9e9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:51.207599 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f87bf933-7cbb-4671-9960-f5fa8e1dfc60 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:51.208336 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f87bf933-7cbb-4671-9960-f5fa8e1dfc60 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:51.215609 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f87bf933-7cbb-4671-9960-f5fa8e1dfc60 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:51.216054 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f87bf933-7cbb-4671-9960-f5fa8e1dfc60 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:51.216808 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f87bf933-7cbb-4671-9960-f5fa8e1dfc60 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:51.217232 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f87bf933-7cbb-4671-9960-f5fa8e1dfc60 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:51.417930 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-f87bf933-7cbb-4671-9960-f5fa8e1dfc60 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:51.426702 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f87bf933-7cbb-4671-9960-f5fa8e1dfc60 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1318 microversion: 2.1 time: 0.223418 Dec 14 10:09:51.427273 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 149/269] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:51 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:51.439226 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-7f3cff46-7f2a-4ecf-a2bc-5a14dae448ed tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:51.439825 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-7f3cff46-7f2a-4ecf-a2bc-5a14dae448ed tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:51.446993 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7f3cff46-7f2a-4ecf-a2bc-5a14dae448ed tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:51.447434 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7f3cff46-7f2a-4ecf-a2bc-5a14dae448ed tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:51.448195 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7f3cff46-7f2a-4ecf-a2bc-5a14dae448ed tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:51.448624 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7f3cff46-7f2a-4ecf-a2bc-5a14dae448ed tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:51.692305 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-7f3cff46-7f2a-4ecf-a2bc-5a14dae448ed tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:51.700316 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-7f3cff46-7f2a-4ecf-a2bc-5a14dae448ed tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1318 microversion: 2.1 time: 0.265573 Dec 14 10:09:51.700873 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 150/270] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:51 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:51.753134 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-fab13e7d-2fb5-44b8-9fc2-17423fc817e9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:51.753743 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-fab13e7d-2fb5-44b8-9fc2-17423fc817e9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:51.760912 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fab13e7d-2fb5-44b8-9fc2-17423fc817e9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:51.761356 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fab13e7d-2fb5-44b8-9fc2-17423fc817e9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:51.762156 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fab13e7d-2fb5-44b8-9fc2-17423fc817e9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:51.762585 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fab13e7d-2fb5-44b8-9fc2-17423fc817e9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:51.951031 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-fab13e7d-2fb5-44b8-9fc2-17423fc817e9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:51.959009 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-fab13e7d-2fb5-44b8-9fc2-17423fc817e9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.210289 Dec 14 10:09:51.959560 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 151/271] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:51 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:51.963790 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-f600b3db-adc8-43f2-bbd6-3bc4fac2cb5f req-ae578068-203e-450a-9e2e-51ad5ad4d841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db6ba6ce-0853-4c2d-9cdd-489058bb57df", "name": "network-vif-plugged", "status": "completed", "tag": "9d76f03f-87f4-41ec-ad81-30ce3cc98300"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:51.965378 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:09:51.965378 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:09:51.973568 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-f600b3db-adc8-43f2-bbd6-3bc4fac2cb5f req-ae578068-203e-450a-9e2e-51ad5ad4d841 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:51.974036 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-f600b3db-adc8-43f2-bbd6-3bc4fac2cb5f req-ae578068-203e-450a-9e2e-51ad5ad4d841 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:51.989590 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-f600b3db-adc8-43f2-bbd6-3bc4fac2cb5f req-ae578068-203e-450a-9e2e-51ad5ad4d841 service nova] Creating event network-vif-plugged:9d76f03f-87f4-41ec-ad81-30ce3cc98300 for instance db6ba6ce-0853-4c2d-9cdd-489058bb57df on hv-cinder-81888 Dec 14 10:09:51.994932 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-f600b3db-adc8-43f2-bbd6-3bc4fac2cb5f req-ae578068-203e-450a-9e2e-51ad5ad4d841 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033420 Dec 14 10:09:51.995512 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 152/272] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:09:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:09:52.444326 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-6e5f878f-3ff4-4a34-b1cd-b7fd57a62926 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:52.445046 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-6e5f878f-3ff4-4a34-b1cd-b7fd57a62926 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:52.453248 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6e5f878f-3ff4-4a34-b1cd-b7fd57a62926 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:52.453766 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6e5f878f-3ff4-4a34-b1cd-b7fd57a62926 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:52.454547 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6e5f878f-3ff4-4a34-b1cd-b7fd57a62926 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:52.454971 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6e5f878f-3ff4-4a34-b1cd-b7fd57a62926 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:52.653091 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-6e5f878f-3ff4-4a34-b1cd-b7fd57a62926 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:52.661428 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-6e5f878f-3ff4-4a34-b1cd-b7fd57a62926 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1318 microversion: 2.1 time: 0.221110 Dec 14 10:09:52.662132 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 153/273] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:52 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:52.716460 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-0aae2c0e-bfc8-401c-86f4-2a049072d5e5 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:52.717058 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-0aae2c0e-bfc8-401c-86f4-2a049072d5e5 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:52.724198 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0aae2c0e-bfc8-401c-86f4-2a049072d5e5 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:52.724635 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0aae2c0e-bfc8-401c-86f4-2a049072d5e5 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:52.725500 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0aae2c0e-bfc8-401c-86f4-2a049072d5e5 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:52.725816 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0aae2c0e-bfc8-401c-86f4-2a049072d5e5 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:52.918439 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-0aae2c0e-bfc8-401c-86f4-2a049072d5e5 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:52.926960 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-0aae2c0e-bfc8-401c-86f4-2a049072d5e5 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1318 microversion: 2.1 time: 0.214148 Dec 14 10:09:52.927511 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 154/274] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:52 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:52.975651 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-99ac5bec-46c5-40c8-8679-49ee94c57ecf tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:52.976278 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-99ac5bec-46c5-40c8-8679-49ee94c57ecf tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:52.983151 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-99ac5bec-46c5-40c8-8679-49ee94c57ecf tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:52.983594 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-99ac5bec-46c5-40c8-8679-49ee94c57ecf tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:52.984866 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-99ac5bec-46c5-40c8-8679-49ee94c57ecf tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:52.985286 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-99ac5bec-46c5-40c8-8679-49ee94c57ecf tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:53.180272 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-99ac5bec-46c5-40c8-8679-49ee94c57ecf tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:53.189119 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-99ac5bec-46c5-40c8-8679-49ee94c57ecf tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.216932 Dec 14 10:09:53.189676 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 155/275] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:52 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:53.677853 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-853bf1e1-4ae9-487e-9deb-4f087304f123 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:53.678529 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-853bf1e1-4ae9-487e-9deb-4f087304f123 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:53.685811 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-853bf1e1-4ae9-487e-9deb-4f087304f123 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:53.686275 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-853bf1e1-4ae9-487e-9deb-4f087304f123 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:53.687035 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-853bf1e1-4ae9-487e-9deb-4f087304f123 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:53.687461 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-853bf1e1-4ae9-487e-9deb-4f087304f123 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:53.889333 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-853bf1e1-4ae9-487e-9deb-4f087304f123 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:53.898010 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-853bf1e1-4ae9-487e-9deb-4f087304f123 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1318 microversion: 2.1 time: 0.223735 Dec 14 10:09:53.898571 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 156/276] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:53 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:53.942876 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d822de7f-aeb4-436d-a390-7d59b4d740dd tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:53.943470 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d822de7f-aeb4-436d-a390-7d59b4d740dd tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:53.950295 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d822de7f-aeb4-436d-a390-7d59b4d740dd tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:53.950732 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d822de7f-aeb4-436d-a390-7d59b4d740dd tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:53.951479 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d822de7f-aeb4-436d-a390-7d59b4d740dd tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:53.951903 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d822de7f-aeb4-436d-a390-7d59b4d740dd tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:54.144476 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d822de7f-aeb4-436d-a390-7d59b4d740dd tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:54.153083 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d822de7f-aeb4-436d-a390-7d59b4d740dd tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1318 microversion: 2.1 time: 0.213462 Dec 14 10:09:54.153647 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 157/277] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:53 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:54.206632 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-df16b658-8353-4523-8be3-9ec4ae910611 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:54.207482 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-df16b658-8353-4523-8be3-9ec4ae910611 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:54.207621 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-81be0862-83fc-4f20-b214-121fa0ace9e9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 28169 microversion: 2.1 time: 3.252557 Dec 14 10:09:54.208561 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 121/278] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:50 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 28169 bytes in 3254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:09:54.215237 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-df16b658-8353-4523-8be3-9ec4ae910611 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:54.215757 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-df16b658-8353-4523-8be3-9ec4ae910611 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:54.216594 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-df16b658-8353-4523-8be3-9ec4ae910611 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:54.217148 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-df16b658-8353-4523-8be3-9ec4ae910611 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:54.505483 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-df16b658-8353-4523-8be3-9ec4ae910611 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:54.513307 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-df16b658-8353-4523-8be3-9ec4ae910611 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.311135 Dec 14 10:09:54.513915 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 158/279] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:54 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:54.917310 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-53ee8d1f-743b-44a9-9838-01239b805eba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:54.917454 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-53ee8d1f-743b-44a9-9838-01239b805eba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:54.926519 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-53ee8d1f-743b-44a9-9838-01239b805eba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:54.927195 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-53ee8d1f-743b-44a9-9838-01239b805eba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:54.928142 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-53ee8d1f-743b-44a9-9838-01239b805eba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:54.928571 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-53ee8d1f-743b-44a9-9838-01239b805eba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:55.151374 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-53ee8d1f-743b-44a9-9838-01239b805eba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:55.160492 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-53ee8d1f-743b-44a9-9838-01239b805eba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1318 microversion: 2.1 time: 0.248637 Dec 14 10:09:55.161255 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 122/280] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:54 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:55.175480 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-29bc2ea2-ca28-4e7c-a72e-cbc170a5d42f tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:55.176251 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-29bc2ea2-ca28-4e7c-a72e-cbc170a5d42f tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:55.185182 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-29bc2ea2-ca28-4e7c-a72e-cbc170a5d42f tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:55.185709 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-29bc2ea2-ca28-4e7c-a72e-cbc170a5d42f tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:55.186623 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-29bc2ea2-ca28-4e7c-a72e-cbc170a5d42f tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:55.187158 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-29bc2ea2-ca28-4e7c-a72e-cbc170a5d42f tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:55.220275 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6e54fa2b-a4b1-4f05-87d3-73b4635e4ae0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:55.222266 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6e54fa2b-a4b1-4f05-87d3-73b4635e4ae0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:55.230149 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6e54fa2b-a4b1-4f05-87d3-73b4635e4ae0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:55.231260 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6e54fa2b-a4b1-4f05-87d3-73b4635e4ae0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:55.232232 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6e54fa2b-a4b1-4f05-87d3-73b4635e4ae0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:55.232822 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6e54fa2b-a4b1-4f05-87d3-73b4635e4ae0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:55.373739 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6e54fa2b-a4b1-4f05-87d3-73b4635e4ae0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 28169 microversion: 2.1 time: 0.158006 Dec 14 10:09:55.374419 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 123/281] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:55 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 28169 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:09:55.423607 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-29bc2ea2-ca28-4e7c-a72e-cbc170a5d42f tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:55.431590 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-29bc2ea2-ca28-4e7c-a72e-cbc170a5d42f tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1318 microversion: 2.1 time: 0.260507 Dec 14 10:09:55.432152 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 159/282] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:55 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:55.532115 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-2e2e94c0-8763-4c44-b375-2f4d21d8b1d2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:55.532582 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-2e2e94c0-8763-4c44-b375-2f4d21d8b1d2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:55.541517 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2e2e94c0-8763-4c44-b375-2f4d21d8b1d2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:55.542379 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2e2e94c0-8763-4c44-b375-2f4d21d8b1d2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:55.543618 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2e2e94c0-8763-4c44-b375-2f4d21d8b1d2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:55.544050 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2e2e94c0-8763-4c44-b375-2f4d21d8b1d2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:55.751340 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-2e2e94c0-8763-4c44-b375-2f4d21d8b1d2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:55.759440 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-2e2e94c0-8763-4c44-b375-2f4d21d8b1d2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1521 microversion: 2.1 time: 0.232466 Dec 14 10:09:55.760001 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 124/283] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:55 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:56.176436 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4a823c52-5e05-486f-8826-54ca912e586e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:56.177041 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4a823c52-5e05-486f-8826-54ca912e586e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:56.194675 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4a823c52-5e05-486f-8826-54ca912e586e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:56.195269 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4a823c52-5e05-486f-8826-54ca912e586e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:56.196340 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4a823c52-5e05-486f-8826-54ca912e586e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:56.196849 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4a823c52-5e05-486f-8826-54ca912e586e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:56.386727 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-ad251150-13a2-4e05-8e51-eec82f8b0640 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:56.387647 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-ad251150-13a2-4e05-8e51-eec82f8b0640 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:56.402012 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ad251150-13a2-4e05-8e51-eec82f8b0640 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:56.402480 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ad251150-13a2-4e05-8e51-eec82f8b0640 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:56.405437 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ad251150-13a2-4e05-8e51-eec82f8b0640 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:56.406223 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ad251150-13a2-4e05-8e51-eec82f8b0640 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:56.585126 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4a823c52-5e05-486f-8826-54ca912e586e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:56.596933 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4a823c52-5e05-486f-8826-54ca912e586e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1507 microversion: 2.1 time: 0.424181 Dec 14 10:09:56.601026 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 160/284] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:56 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1507 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:56.602004 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-ad251150-13a2-4e05-8e51-eec82f8b0640 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 28169 microversion: 2.1 time: 0.218591 Dec 14 10:09:56.603208 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 125/285] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:56 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 28169 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:09:56.611215 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-135e0bfc-6f97-45c7-b7f6-f6ee908c4d13 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:56.611833 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-135e0bfc-6f97-45c7-b7f6-f6ee908c4d13 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:56.633681 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-135e0bfc-6f97-45c7-b7f6-f6ee908c4d13 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:56.634170 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-135e0bfc-6f97-45c7-b7f6-f6ee908c4d13 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:56.637119 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-135e0bfc-6f97-45c7-b7f6-f6ee908c4d13 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:56.637542 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-135e0bfc-6f97-45c7-b7f6-f6ee908c4d13 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:56.777260 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a2cee4db-02e1-4688-9412-7515cbcf12e0 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:56.778097 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a2cee4db-02e1-4688-9412-7515cbcf12e0 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:56.800659 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a2cee4db-02e1-4688-9412-7515cbcf12e0 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:56.803430 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a2cee4db-02e1-4688-9412-7515cbcf12e0 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:56.811126 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a2cee4db-02e1-4688-9412-7515cbcf12e0 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:56.811768 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a2cee4db-02e1-4688-9412-7515cbcf12e0 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:57.170314 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-135e0bfc-6f97-45c7-b7f6-f6ee908c4d13 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:57.191468 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-135e0bfc-6f97-45c7-b7f6-f6ee908c4d13 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1508 microversion: 2.1 time: 0.589164 Dec 14 10:09:57.192070 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 161/286] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:56 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1508 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:57.227922 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-a2cee4db-02e1-4688-9412-7515cbcf12e0 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:57.253136 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a2cee4db-02e1-4688-9412-7515cbcf12e0 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1501 microversion: 2.1 time: 0.478979 Dec 14 10:09:57.253743 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 126/287] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:56 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1501 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:09:57.270237 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d93a1961-7493-4e2d-a275-fae8950f0f00 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:09:57.271035 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d93a1961-7493-4e2d-a275-fae8950f0f00 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:57.290745 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d93a1961-7493-4e2d-a275-fae8950f0f00 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:57.291365 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d93a1961-7493-4e2d-a275-fae8950f0f00 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:57.292319 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d93a1961-7493-4e2d-a275-fae8950f0f00 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:57.293524 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d93a1961-7493-4e2d-a275-fae8950f0f00 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:57.572836 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d93a1961-7493-4e2d-a275-fae8950f0f00 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:09:57.583389 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d93a1961-7493-4e2d-a275-fae8950f0f00 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1515 microversion: 2.1 time: 0.318088 Dec 14 10:09:57.584077 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 162/288] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:09:57 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1515 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:09:57.615563 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-cd361e06-3ddf-415b-889f-04e6b37b2dc7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:09:57.617329 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-cd361e06-3ddf-415b-889f-04e6b37b2dc7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:09:57.627808 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cd361e06-3ddf-415b-889f-04e6b37b2dc7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:57.628551 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cd361e06-3ddf-415b-889f-04e6b37b2dc7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:09:57.629944 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cd361e06-3ddf-415b-889f-04e6b37b2dc7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:09:57.631184 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cd361e06-3ddf-415b-889f-04e6b37b2dc7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:00.514970 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-cd361e06-3ddf-415b-889f-04e6b37b2dc7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 28460 microversion: 2.1 time: 2.904638 Dec 14 10:10:00.521691 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 127/289] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:09:57 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 28460 bytes in 2912 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:10:01.529072 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-7d1d76c3-7dcb-4480-9cb3-8f9b4c9f410a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:01.530292 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-7d1d76c3-7dcb-4480-9cb3-8f9b4c9f410a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:01.552325 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7d1d76c3-7dcb-4480-9cb3-8f9b4c9f410a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:01.552872 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7d1d76c3-7dcb-4480-9cb3-8f9b4c9f410a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:01.553746 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7d1d76c3-7dcb-4480-9cb3-8f9b4c9f410a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:01.554271 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7d1d76c3-7dcb-4480-9cb3-8f9b4c9f410a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:01.737875 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-52ba0a28-e431-4261-9f05-bd8d9dcb0a8f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:01.739152 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-52ba0a28-e431-4261-9f05-bd8d9dcb0a8f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:01.747457 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-52ba0a28-e431-4261-9f05-bd8d9dcb0a8f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:01.747967 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-52ba0a28-e431-4261-9f05-bd8d9dcb0a8f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:01.748970 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-52ba0a28-e431-4261-9f05-bd8d9dcb0a8f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:01.749415 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-52ba0a28-e431-4261-9f05-bd8d9dcb0a8f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:01.763214 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-7d1d76c3-7dcb-4480-9cb3-8f9b4c9f410a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 28460 microversion: 2.1 time: 0.237916 Dec 14 10:10:01.764527 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 163/290] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:01 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 28460 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:10:01.852094 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5c17fc91-8d05-40af-8ea2-ac80a5739d09 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f02c406-abbd-43b0-8bd7-d18edd5ffc08"}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:01.853843 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5c17fc91-8d05-40af-8ea2-ac80a5739d09 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:01.869120 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5c17fc91-8d05-40af-8ea2-ac80a5739d09 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:01.869582 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5c17fc91-8d05-40af-8ea2-ac80a5739d09 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:01.870398 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5c17fc91-8d05-40af-8ea2-ac80a5739d09 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:01.870835 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5c17fc91-8d05-40af-8ea2-ac80a5739d09 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:01.875775 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.objects.instance [None req-52ba0a28-e431-4261-9f05-bd8d9dcb0a8f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lazy-loading 'flavor' on Instance uuid 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd {{(pid=100985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:10:02.169174 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-52ba0a28-e431-4261-9f05-bd8d9dcb0a8f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "POST /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/action" status: 200 len: 32 microversion: 2.1 time: 0.440582 Dec 14 10:10:02.170035 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 128/291] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:01 2021] POST /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/action => generated 32 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 10:10:02.185145 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-442c36e7-1773-4bea-87a7-6f1f75192e43 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:02.186114 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-442c36e7-1773-4bea-87a7-6f1f75192e43 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:02.199088 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-442c36e7-1773-4bea-87a7-6f1f75192e43 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:02.199649 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-442c36e7-1773-4bea-87a7-6f1f75192e43 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:02.200434 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-442c36e7-1773-4bea-87a7-6f1f75192e43 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:02.200863 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-442c36e7-1773-4bea-87a7-6f1f75192e43 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:02.515083 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-442c36e7-1773-4bea-87a7-6f1f75192e43 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:02.525390 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-442c36e7-1773-4bea-87a7-6f1f75192e43 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.344609 Dec 14 10:10:02.535543 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 129/292] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:02 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:02.777818 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b6661272-4f86-4f3d-a022-eb333428f2a0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:02.779953 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-b6661272-4f86-4f3d-a022-eb333428f2a0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:02.789598 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b6661272-4f86-4f3d-a022-eb333428f2a0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:02.790367 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b6661272-4f86-4f3d-a022-eb333428f2a0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:02.791342 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b6661272-4f86-4f3d-a022-eb333428f2a0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:02.791940 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b6661272-4f86-4f3d-a022-eb333428f2a0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:05.659363 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-b6661272-4f86-4f3d-a022-eb333428f2a0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 29040 microversion: 2.1 time: 2.886388 Dec 14 10:10:05.663923 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 130/293] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:02 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 29040 bytes in 2892 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:10:05.669590 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b47640d9-ba2c-49e3-9e8f-d2933e5453a5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:05.674507 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-b47640d9-ba2c-49e3-9e8f-d2933e5453a5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:05.691596 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b47640d9-ba2c-49e3-9e8f-d2933e5453a5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:05.692043 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b47640d9-ba2c-49e3-9e8f-d2933e5453a5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:05.692837 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b47640d9-ba2c-49e3-9e8f-d2933e5453a5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:05.693293 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b47640d9-ba2c-49e3-9e8f-d2933e5453a5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:05.834217 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5c17fc91-8d05-40af-8ea2-ac80a5739d09 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "POST /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.986391 Dec 14 10:10:05.835182 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 164/294] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Dec 14 10:10:01 2021] POST /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214/os-volume_attachments => generated 194 bytes in 3988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:10:06.267372 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-b47640d9-ba2c-49e3-9e8f-d2933e5453a5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:06.277621 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-b47640d9-ba2c-49e3-9e8f-d2933e5453a5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.612225 Dec 14 10:10:06.279026 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 131/295] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:05 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:06.672794 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-ded765c0-4a74-48d3-bb4a-1002adba71ca tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:06.674417 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-ded765c0-4a74-48d3-bb4a-1002adba71ca tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:06.682416 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ded765c0-4a74-48d3-bb4a-1002adba71ca tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:06.682873 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ded765c0-4a74-48d3-bb4a-1002adba71ca tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:06.683909 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ded765c0-4a74-48d3-bb4a-1002adba71ca tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:06.684509 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ded765c0-4a74-48d3-bb4a-1002adba71ca tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:07.300969 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-679f40ca-e231-4b33-9b75-bff36a4c3deb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:07.302674 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-679f40ca-e231-4b33-9b75-bff36a4c3deb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:07.311987 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-679f40ca-e231-4b33-9b75-bff36a4c3deb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:07.313239 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-679f40ca-e231-4b33-9b75-bff36a4c3deb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:07.315336 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-679f40ca-e231-4b33-9b75-bff36a4c3deb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:07.316027 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-679f40ca-e231-4b33-9b75-bff36a4c3deb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:07.783067 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-679f40ca-e231-4b33-9b75-bff36a4c3deb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:07.793152 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-679f40ca-e231-4b33-9b75-bff36a4c3deb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.495550 Dec 14 10:10:07.796621 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 132/296] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:07 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:10:08.809769 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-21e63db0-08f7-4357-b32b-fe05c468a899 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:08.810409 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-21e63db0-08f7-4357-b32b-fe05c468a899 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:08.830662 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-21e63db0-08f7-4357-b32b-fe05c468a899 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:08.831301 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-21e63db0-08f7-4357-b32b-fe05c468a899 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:08.838897 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-21e63db0-08f7-4357-b32b-fe05c468a899 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:08.839506 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-21e63db0-08f7-4357-b32b-fe05c468a899 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:09.229046 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-21e63db0-08f7-4357-b32b-fe05c468a899 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:09.239314 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-21e63db0-08f7-4357-b32b-fe05c468a899 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.433038 Dec 14 10:10:09.250978 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 133/297] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:08 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:10:09.445316 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-ded765c0-4a74-48d3-bb4a-1002adba71ca tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 29040 microversion: 2.1 time: 2.777216 Dec 14 10:10:09.452409 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 165/298] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:06 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 29040 bytes in 2785 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:10:10.257788 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3f96f101-719c-41e5-9f1a-dd12e3d94d17 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:10.258537 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3f96f101-719c-41e5-9f1a-dd12e3d94d17 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:10.271615 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3f96f101-719c-41e5-9f1a-dd12e3d94d17 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:10.272069 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3f96f101-719c-41e5-9f1a-dd12e3d94d17 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:10.275528 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3f96f101-719c-41e5-9f1a-dd12e3d94d17 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:10.276053 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3f96f101-719c-41e5-9f1a-dd12e3d94d17 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:10.461430 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1fa4d602-13c3-4ceb-9f03-b09972cdb600 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:10.462665 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1fa4d602-13c3-4ceb-9f03-b09972cdb600 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:10.478287 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1fa4d602-13c3-4ceb-9f03-b09972cdb600 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:10.478739 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1fa4d602-13c3-4ceb-9f03-b09972cdb600 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:10.479618 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1fa4d602-13c3-4ceb-9f03-b09972cdb600 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:10.479940 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1fa4d602-13c3-4ceb-9f03-b09972cdb600 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:10.784674 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1fa4d602-13c3-4ceb-9f03-b09972cdb600 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 29040 microversion: 2.1 time: 0.327550 Dec 14 10:10:10.790193 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 166/299] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:10 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 29040 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:10:10.793579 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3f96f101-719c-41e5-9f1a-dd12e3d94d17 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:10.807530 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3f96f101-719c-41e5-9f1a-dd12e3d94d17 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.553630 Dec 14 10:10:10.808791 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 134/300] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:10 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:11.798792 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-7f2f80c1-42b8-4b65-a349-2dbbda447c79 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:11.800534 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-7f2f80c1-42b8-4b65-a349-2dbbda447c79 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:11.814532 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7f2f80c1-42b8-4b65-a349-2dbbda447c79 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:11.819404 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7f2f80c1-42b8-4b65-a349-2dbbda447c79 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:11.820484 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7f2f80c1-42b8-4b65-a349-2dbbda447c79 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:11.820921 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7f2f80c1-42b8-4b65-a349-2dbbda447c79 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:11.828550 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-be4f94ce-286a-4ff4-ae15-13806b2a765a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:11.829178 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-be4f94ce-286a-4ff4-ae15-13806b2a765a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:11.843506 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-be4f94ce-286a-4ff4-ae15-13806b2a765a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:11.843962 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-be4f94ce-286a-4ff4-ae15-13806b2a765a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:11.844833 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-be4f94ce-286a-4ff4-ae15-13806b2a765a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:11.845442 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-be4f94ce-286a-4ff4-ae15-13806b2a765a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:12.112653 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-be4f94ce-286a-4ff4-ae15-13806b2a765a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:12.121535 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-be4f94ce-286a-4ff4-ae15-13806b2a765a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.300433 Dec 14 10:10:12.131523 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 135/301] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:11 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:12.189318 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-7f2f80c1-42b8-4b65-a349-2dbbda447c79 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 29040 microversion: 2.1 time: 0.395765 Dec 14 10:10:12.190317 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 167/302] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:11 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 29040 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:10:13.145917 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c8f29ef5-09bd-4eeb-a2cf-317cfe2ca6c5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:13.148909 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c8f29ef5-09bd-4eeb-a2cf-317cfe2ca6c5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:13.166953 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c8f29ef5-09bd-4eeb-a2cf-317cfe2ca6c5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:13.167406 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c8f29ef5-09bd-4eeb-a2cf-317cfe2ca6c5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:13.168184 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c8f29ef5-09bd-4eeb-a2cf-317cfe2ca6c5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:13.169165 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c8f29ef5-09bd-4eeb-a2cf-317cfe2ca6c5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:13.402413 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5fbdbb3f-f5fd-4f9e-b44f-d673963f2f69 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Action: 'create', calling method: .version_select at 0x7fb179017430>, body: {"keypair": {"name": "tempest-TestShelveInstance-2076031675"}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:13.425361 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-5fbdbb3f-f5fd-4f9e-b44f-d673963f2f69 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Getting quotas for project a588cde51b9d45b2844c4ffc951dac41. Resources: {'key_pairs'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:10:13.429284 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-5fbdbb3f-f5fd-4f9e-b44f-d673963f2f69 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Getting quotas for user 235d3d850d9e4d90bb29d5f891e23419 and project a588cde51b9d45b2844c4ffc951dac41. Resources: {'key_pairs'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:10:13.537599 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-c8f29ef5-09bd-4eeb-a2cf-317cfe2ca6c5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:13.550484 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c8f29ef5-09bd-4eeb-a2cf-317cfe2ca6c5 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.415694 Dec 14 10:10:13.560476 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 136/303] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:13 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:13.569158 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-05c4350c-4925-416e-b8af-f6f2249ef34c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:13.570090 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-05c4350c-4925-416e-b8af-f6f2249ef34c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:13.577144 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-05c4350c-4925-416e-b8af-f6f2249ef34c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:13.577990 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-05c4350c-4925-416e-b8af-f6f2249ef34c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:13.578912 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-05c4350c-4925-416e-b8af-f6f2249ef34c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:13.579344 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-05c4350c-4925-416e-b8af-f6f2249ef34c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:13.657940 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-5fbdbb3f-f5fd-4f9e-b44f-d673963f2f69 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Getting quotas for project a588cde51b9d45b2844c4ffc951dac41. Resources: {'key_pairs'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:10:13.662055 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-5fbdbb3f-f5fd-4f9e-b44f-d673963f2f69 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Getting quotas for user 235d3d850d9e4d90bb29d5f891e23419 and project a588cde51b9d45b2844c4ffc951dac41. Resources: {'key_pairs'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:10:13.679837 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5fbdbb3f-f5fd-4f9e-b44f-d673963f2f69 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.492889 Dec 14 10:10:13.682132 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 168/304] 10.222.0.20 () {60 vars in 1157 bytes} [Tue Dec 14 10:10:13 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:14.571134 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-52b0ce00-839d-4695-b54b-75cada82310b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:14.573354 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-52b0ce00-839d-4695-b54b-75cada82310b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:14.586725 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-52b0ce00-839d-4695-b54b-75cada82310b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:14.587486 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-52b0ce00-839d-4695-b54b-75cada82310b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:14.588450 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-52b0ce00-839d-4695-b54b-75cada82310b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:14.589445 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-52b0ce00-839d-4695-b54b-75cada82310b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:14.891463 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-52b0ce00-839d-4695-b54b-75cada82310b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:14.905520 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-52b0ce00-839d-4695-b54b-75cada82310b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.340447 Dec 14 10:10:14.908231 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 169/305] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:14 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:10:15.433418 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-05c4350c-4925-416e-b8af-f6f2249ef34c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 29040 microversion: 2.1 time: 1.867757 Dec 14 10:10:15.437731 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 137/306] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:13 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 29040 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:10:15.925121 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-cbaf1a54-05a5-47f9-92da-9160045798a4 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:15.926404 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-cbaf1a54-05a5-47f9-92da-9160045798a4 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:15.941550 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cbaf1a54-05a5-47f9-92da-9160045798a4 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:15.942382 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cbaf1a54-05a5-47f9-92da-9160045798a4 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:15.943412 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cbaf1a54-05a5-47f9-92da-9160045798a4 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:15.944747 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cbaf1a54-05a5-47f9-92da-9160045798a4 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:16.447131 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-cdcd96f3-48f4-4596-be48-ceb613b11af4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:16.448320 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-cdcd96f3-48f4-4596-be48-ceb613b11af4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:16.469135 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-cbaf1a54-05a5-47f9-92da-9160045798a4 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:16.475477 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cdcd96f3-48f4-4596-be48-ceb613b11af4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:16.476973 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cdcd96f3-48f4-4596-be48-ceb613b11af4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:16.478053 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cdcd96f3-48f4-4596-be48-ceb613b11af4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:16.481105 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cdcd96f3-48f4-4596-be48-ceb613b11af4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:16.493332 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-cbaf1a54-05a5-47f9-92da-9160045798a4 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.572532 Dec 14 10:10:16.494182 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 170/307] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:15 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:16.780493 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-cdcd96f3-48f4-4596-be48-ceb613b11af4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 29040 microversion: 2.1 time: 0.339144 Dec 14 10:10:16.785513 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 138/308] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:16 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 29040 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:10:17.514476 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e804d47a-cc84-4856-82db-e37a25ae049d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:17.515719 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e804d47a-cc84-4856-82db-e37a25ae049d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:17.527482 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e804d47a-cc84-4856-82db-e37a25ae049d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:17.528127 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e804d47a-cc84-4856-82db-e37a25ae049d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:17.529878 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e804d47a-cc84-4856-82db-e37a25ae049d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:17.531267 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e804d47a-cc84-4856-82db-e37a25ae049d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:17.795529 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-02301e9b-baab-4043-a240-220f6c033925 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:17.797537 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-02301e9b-baab-4043-a240-220f6c033925 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:17.813636 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-02301e9b-baab-4043-a240-220f6c033925 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:17.814383 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-02301e9b-baab-4043-a240-220f6c033925 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:17.815362 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-02301e9b-baab-4043-a240-220f6c033925 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:17.815877 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-02301e9b-baab-4043-a240-220f6c033925 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:17.903103 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e804d47a-cc84-4856-82db-e37a25ae049d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:17.911384 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e804d47a-cc84-4856-82db-e37a25ae049d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.404035 Dec 14 10:10:17.911944 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 171/309] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:17 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:18.012280 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-02301e9b-baab-4043-a240-220f6c033925 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 29040 microversion: 2.1 time: 0.221771 Dec 14 10:10:18.018363 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 139/310] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:17 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 29040 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:10:18.084488 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-14199ae3-579a-437b-8463-a9c1fbea4615 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f02c406-abbd-43b0-8bd7-d18edd5ffc08"}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:18.086262 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-14199ae3-579a-437b-8463-a9c1fbea4615 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:18.096766 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-14199ae3-579a-437b-8463-a9c1fbea4615 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:18.097347 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-14199ae3-579a-437b-8463-a9c1fbea4615 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:18.098361 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-14199ae3-579a-437b-8463-a9c1fbea4615 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:18.098956 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-14199ae3-579a-437b-8463-a9c1fbea4615 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:18.276466 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-14199ae3-579a-437b-8463-a9c1fbea4615 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] HTTP exception thrown: Invalid volume: volume 4f02c406-abbd-43b0-8bd7-d18edd5ffc08 is already attached to instances: 9e60e3bf-4317-4c75-87fd-d9dd68489214 Dec 14 10:10:18.277054 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-14199ae3-579a-437b-8463-a9c1fbea4615 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Returning 400 to user: Invalid volume: volume 4f02c406-abbd-43b0-8bd7-d18edd5ffc08 is already attached to instances: 9e60e3bf-4317-4c75-87fd-d9dd68489214 {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:10:18.277861 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-14199ae3-579a-437b-8463-a9c1fbea4615 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "POST /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.198554 Dec 14 10:10:18.278571 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 172/311] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Dec 14 10:10:18 2021] POST /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214/os-volume_attachments => generated 174 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 14 10:10:18.371929 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-1bb6d172-d5e6-4ef3-83a2-4016c9adb789 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:18.378882 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-1bb6d172-d5e6-4ef3-83a2-4016c9adb789 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:18.387386 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1bb6d172-d5e6-4ef3-83a2-4016c9adb789 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:18.387946 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1bb6d172-d5e6-4ef3-83a2-4016c9adb789 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:18.388621 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1bb6d172-d5e6-4ef3-83a2-4016c9adb789 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:18.389057 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1bb6d172-d5e6-4ef3-83a2-4016c9adb789 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:18.542242 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.objects.instance [None req-1bb6d172-d5e6-4ef3-83a2-4016c9adb789 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lazy-loading 'services' on Instance uuid 9e60e3bf-4317-4c75-87fd-d9dd68489214 {{(pid=100985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:10:18.702142 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-1bb6d172-d5e6-4ef3-83a2-4016c9adb789 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214/os-volume_attachments/4f02c406-abbd-43b0-8bd7-d18edd5ffc08" status: 202 len: 0 microversion: 2.1 time: 0.334545 Dec 14 10:10:18.703344 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 140/312] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Dec 14 10:10:18 2021] DELETE /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214/os-volume_attachments/4f02c406-abbd-43b0-8bd7-d18edd5ffc08 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:10:18.711450 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-33858e1c-e175-42e0-b99d-e3852226be66 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:18.712371 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-33858e1c-e175-42e0-b99d-e3852226be66 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:18.721064 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-33858e1c-e175-42e0-b99d-e3852226be66 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:18.721504 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-33858e1c-e175-42e0-b99d-e3852226be66 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:18.722309 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-33858e1c-e175-42e0-b99d-e3852226be66 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:18.722989 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-33858e1c-e175-42e0-b99d-e3852226be66 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:18.790680 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-33858e1c-e175-42e0-b99d-e3852226be66 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082878 Dec 14 10:10:18.791247 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 173/313] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:10:18 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:10:18.928735 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-8c9ff139-4600-4455-9596-061e50d547af tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:18.929534 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-8c9ff139-4600-4455-9596-061e50d547af tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:18.938826 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8c9ff139-4600-4455-9596-061e50d547af tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:18.939115 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8c9ff139-4600-4455-9596-061e50d547af tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:18.940580 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8c9ff139-4600-4455-9596-061e50d547af tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:18.941107 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8c9ff139-4600-4455-9596-061e50d547af tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:19.025908 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-9fb7f6e5-7871-4ecb-ba82-44f5c73ebc86 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:19.026872 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-9fb7f6e5-7871-4ecb-ba82-44f5c73ebc86 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:19.040775 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9fb7f6e5-7871-4ecb-ba82-44f5c73ebc86 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:19.041229 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9fb7f6e5-7871-4ecb-ba82-44f5c73ebc86 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:19.042046 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9fb7f6e5-7871-4ecb-ba82-44f5c73ebc86 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:19.042482 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9fb7f6e5-7871-4ecb-ba82-44f5c73ebc86 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:19.196436 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-9fb7f6e5-7871-4ecb-ba82-44f5c73ebc86 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 29040 microversion: 2.1 time: 0.175217 Dec 14 10:10:19.208633 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 174/314] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:19 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 29040 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:10:19.290876 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-8c9ff139-4600-4455-9596-061e50d547af tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:19.302948 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-8c9ff139-4600-4455-9596-061e50d547af tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.378024 Dec 14 10:10:19.304204 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 141/315] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:18 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:19.804653 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-b8c53e93-2fa0-45d7-aa6d-b5435e98002e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:19.806073 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-b8c53e93-2fa0-45d7-aa6d-b5435e98002e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:19.814286 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b8c53e93-2fa0-45d7-aa6d-b5435e98002e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:19.814873 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b8c53e93-2fa0-45d7-aa6d-b5435e98002e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:19.815717 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b8c53e93-2fa0-45d7-aa6d-b5435e98002e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:19.816216 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b8c53e93-2fa0-45d7-aa6d-b5435e98002e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:19.885647 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-b8c53e93-2fa0-45d7-aa6d-b5435e98002e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086496 Dec 14 10:10:19.886300 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 175/316] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:10:19 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:10:20.214795 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-ee5f4be1-44c4-44db-be85-c9df57c6eaa3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:20.214795 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-ee5f4be1-44c4-44db-be85-c9df57c6eaa3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:20.221102 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ee5f4be1-44c4-44db-be85-c9df57c6eaa3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:20.221513 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ee5f4be1-44c4-44db-be85-c9df57c6eaa3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:20.222312 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ee5f4be1-44c4-44db-be85-c9df57c6eaa3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:20.222743 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ee5f4be1-44c4-44db-be85-c9df57c6eaa3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:20.321063 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-560d3bf0-9ab6-4259-8788-353fe64c23fb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:20.321654 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-560d3bf0-9ab6-4259-8788-353fe64c23fb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:20.330636 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-560d3bf0-9ab6-4259-8788-353fe64c23fb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:20.331193 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-560d3bf0-9ab6-4259-8788-353fe64c23fb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:20.332112 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-560d3bf0-9ab6-4259-8788-353fe64c23fb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:20.336438 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-ee5f4be1-44c4-44db-be85-c9df57c6eaa3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 29040 microversion: 2.1 time: 0.130441 Dec 14 10:10:20.338770 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 142/317] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:20 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 29040 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:10:20.338899 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-560d3bf0-9ab6-4259-8788-353fe64c23fb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:20.577150 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-560d3bf0-9ab6-4259-8788-353fe64c23fb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:20.587603 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-560d3bf0-9ab6-4259-8788-353fe64c23fb tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.270558 Dec 14 10:10:20.588488 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 176/318] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:20 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:20.897892 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e3c07cf0-80c2-4be6-aa18-12bf0d2a47bf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:20.900064 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e3c07cf0-80c2-4be6-aa18-12bf0d2a47bf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:20.915266 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e3c07cf0-80c2-4be6-aa18-12bf0d2a47bf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:20.915709 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e3c07cf0-80c2-4be6-aa18-12bf0d2a47bf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:20.916489 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e3c07cf0-80c2-4be6-aa18-12bf0d2a47bf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:20.917095 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e3c07cf0-80c2-4be6-aa18-12bf0d2a47bf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:20.986555 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e3c07cf0-80c2-4be6-aa18-12bf0d2a47bf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093167 Dec 14 10:10:20.987113 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 143/319] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:10:20 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 10:10:21.272570 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-6a97b901-3d48-4a4f-85d1-a5a7d2fa68c6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-689680687", "imageRef": "5be36fdc-2baa-4efd-b830-5a5c3fd7beba", "flavorRef": "452", "networks": [{"uuid": "fcd0582b-f091-4bb6-bfce-2519464100b0"}]}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:21.353360 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-d5b9f98a-6ab2-443f-a9e6-535a8d0a3609 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:21.355130 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-d5b9f98a-6ab2-443f-a9e6-535a8d0a3609 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:21.368414 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d5b9f98a-6ab2-443f-a9e6-535a8d0a3609 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:21.369383 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d5b9f98a-6ab2-443f-a9e6-535a8d0a3609 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:21.370996 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d5b9f98a-6ab2-443f-a9e6-535a8d0a3609 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:21.371791 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d5b9f98a-6ab2-443f-a9e6-535a8d0a3609 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:24.493358 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-d5b9f98a-6ab2-443f-a9e6-535a8d0a3609 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 29040 microversion: 2.1 time: 3.147063 Dec 14 10:10:24.497802 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 144/320] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:21 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 29040 bytes in 3151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:10:24.499491 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-cde48e31-9267-44cd-a331-5179a4893850 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:24.500247 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-cde48e31-9267-44cd-a331-5179a4893850 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:24.508522 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cde48e31-9267-44cd-a331-5179a4893850 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:24.508951 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cde48e31-9267-44cd-a331-5179a4893850 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:24.509927 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cde48e31-9267-44cd-a331-5179a4893850 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:24.510698 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cde48e31-9267-44cd-a331-5179a4893850 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:24.730579 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-cde48e31-9267-44cd-a331-5179a4893850 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:24.739331 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-cde48e31-9267-44cd-a331-5179a4893850 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.244188 Dec 14 10:10:24.739909 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 145/321] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:24 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:25.513918 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c3b9cce5-d1f6-42f6-ae6f-73c8a7ad30cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:25.516432 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c3b9cce5-d1f6-42f6-ae6f-73c8a7ad30cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:25.528634 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c3b9cce5-d1f6-42f6-ae6f-73c8a7ad30cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:25.529246 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c3b9cce5-d1f6-42f6-ae6f-73c8a7ad30cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:25.530745 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c3b9cce5-d1f6-42f6-ae6f-73c8a7ad30cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:25.531864 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c3b9cce5-d1f6-42f6-ae6f-73c8a7ad30cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:25.657063 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c3b9cce5-d1f6-42f6-ae6f-73c8a7ad30cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 29040 microversion: 2.1 time: 0.154065 Dec 14 10:10:25.658129 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 146/322] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:25 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 29040 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:10:25.757173 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-26e684cc-d252-4c7a-8705-a2211e12f356 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:25.758022 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-26e684cc-d252-4c7a-8705-a2211e12f356 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:25.766004 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-26e684cc-d252-4c7a-8705-a2211e12f356 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:25.766469 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-26e684cc-d252-4c7a-8705-a2211e12f356 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:25.767394 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-26e684cc-d252-4c7a-8705-a2211e12f356 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:25.767839 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-26e684cc-d252-4c7a-8705-a2211e12f356 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:26.107659 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-26e684cc-d252-4c7a-8705-a2211e12f356 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:26.117835 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-26e684cc-d252-4c7a-8705-a2211e12f356 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.364909 Dec 14 10:10:26.118689 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 147/323] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:25 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:10:26.668812 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f3ccfab8-5cca-4fbb-88e3-20f4294bbc73 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:26.669854 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f3ccfab8-5cca-4fbb-88e3-20f4294bbc73 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:26.679106 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f3ccfab8-5cca-4fbb-88e3-20f4294bbc73 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:26.679106 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f3ccfab8-5cca-4fbb-88e3-20f4294bbc73 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:26.680020 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f3ccfab8-5cca-4fbb-88e3-20f4294bbc73 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:26.680419 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f3ccfab8-5cca-4fbb-88e3-20f4294bbc73 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:28.870509 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f3ccfab8-5cca-4fbb-88e3-20f4294bbc73 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 29040 microversion: 2.1 time: 2.205361 Dec 14 10:10:28.874655 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 148/324] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:26 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 29040 bytes in 2207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:10:28.876577 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-7d7b46d6-1c4f-4116-9ff6-0afe82c9fdb6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:28.878692 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-7d7b46d6-1c4f-4116-9ff6-0afe82c9fdb6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:28.886809 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7d7b46d6-1c4f-4116-9ff6-0afe82c9fdb6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:28.887282 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7d7b46d6-1c4f-4116-9ff6-0afe82c9fdb6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:28.888047 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7d7b46d6-1c4f-4116-9ff6-0afe82c9fdb6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:28.888479 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7d7b46d6-1c4f-4116-9ff6-0afe82c9fdb6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:29.137658 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-7d7b46d6-1c4f-4116-9ff6-0afe82c9fdb6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:29.147113 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-7d7b46d6-1c4f-4116-9ff6-0afe82c9fdb6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.274783 Dec 14 10:10:29.147676 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 149/325] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:28 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:29.881493 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-baf43f48-5f52-4410-95e2-c6ab262ab894 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:29.882428 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-baf43f48-5f52-4410-95e2-c6ab262ab894 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:29.890005 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-baf43f48-5f52-4410-95e2-c6ab262ab894 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:29.890454 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-baf43f48-5f52-4410-95e2-c6ab262ab894 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:29.891231 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-baf43f48-5f52-4410-95e2-c6ab262ab894 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:29.891658 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-baf43f48-5f52-4410-95e2-c6ab262ab894 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:30.010707 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-baf43f48-5f52-4410-95e2-c6ab262ab894 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 29040 microversion: 2.1 time: 0.132481 Dec 14 10:10:30.012198 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 150/326] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:29 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 29040 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:10:30.165234 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3cad3af9-ce20-4ca7-bbe7-d7a7bc5ecb4a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:30.165797 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3cad3af9-ce20-4ca7-bbe7-d7a7bc5ecb4a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:30.174398 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3cad3af9-ce20-4ca7-bbe7-d7a7bc5ecb4a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:30.175313 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3cad3af9-ce20-4ca7-bbe7-d7a7bc5ecb4a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:30.176126 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3cad3af9-ce20-4ca7-bbe7-d7a7bc5ecb4a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:30.176559 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3cad3af9-ce20-4ca7-bbe7-d7a7bc5ecb4a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:30.383082 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3cad3af9-ce20-4ca7-bbe7-d7a7bc5ecb4a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:30.391422 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3cad3af9-ce20-4ca7-bbe7-d7a7bc5ecb4a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.230535 Dec 14 10:10:30.391983 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 151/327] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:30 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:10:31.022833 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-7d96a7dd-2251-40de-b9fd-378dba895d8b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:31.023768 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-7d96a7dd-2251-40de-b9fd-378dba895d8b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:31.036198 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7d96a7dd-2251-40de-b9fd-378dba895d8b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:31.036646 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7d96a7dd-2251-40de-b9fd-378dba895d8b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:31.037415 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7d96a7dd-2251-40de-b9fd-378dba895d8b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:31.037846 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7d96a7dd-2251-40de-b9fd-378dba895d8b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:33.300899 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-7d96a7dd-2251-40de-b9fd-378dba895d8b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 29040 microversion: 2.1 time: 2.281551 Dec 14 10:10:33.304754 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 152/328] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:31 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 29040 bytes in 2283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:10:33.307051 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b88c06c4-1d40-4a0e-ae85-e0c372132561 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:33.307841 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-b88c06c4-1d40-4a0e-ae85-e0c372132561 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:33.316753 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b88c06c4-1d40-4a0e-ae85-e0c372132561 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:33.317197 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b88c06c4-1d40-4a0e-ae85-e0c372132561 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:33.317988 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b88c06c4-1d40-4a0e-ae85-e0c372132561 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:33.318429 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b88c06c4-1d40-4a0e-ae85-e0c372132561 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:33.524142 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-b88c06c4-1d40-4a0e-ae85-e0c372132561 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:33.532450 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-b88c06c4-1d40-4a0e-ae85-e0c372132561 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.229210 Dec 14 10:10:33.533005 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 153/329] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:33 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:34.312751 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-27b3527b-c687-44b4-83c9-aa3bfee90c3c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:34.313731 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-27b3527b-c687-44b4-83c9-aa3bfee90c3c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:34.322284 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-27b3527b-c687-44b4-83c9-aa3bfee90c3c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:34.322762 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-27b3527b-c687-44b4-83c9-aa3bfee90c3c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:34.323548 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-27b3527b-c687-44b4-83c9-aa3bfee90c3c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:34.323988 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-27b3527b-c687-44b4-83c9-aa3bfee90c3c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:34.478582 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-27b3527b-c687-44b4-83c9-aa3bfee90c3c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 29176 microversion: 2.1 time: 0.169541 Dec 14 10:10:34.479202 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 154/330] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:34 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 29176 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:10:34.550612 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3a9f2103-f85a-4e45-9a0f-2282c2129938 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:34.551370 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3a9f2103-f85a-4e45-9a0f-2282c2129938 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:34.559256 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3a9f2103-f85a-4e45-9a0f-2282c2129938 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:34.559720 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3a9f2103-f85a-4e45-9a0f-2282c2129938 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:34.560468 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3a9f2103-f85a-4e45-9a0f-2282c2129938 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:34.560903 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3a9f2103-f85a-4e45-9a0f-2282c2129938 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:34.757257 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3a9f2103-f85a-4e45-9a0f-2282c2129938 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:34.765588 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3a9f2103-f85a-4e45-9a0f-2282c2129938 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.219669 Dec 14 10:10:34.766194 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 155/331] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:34 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:10:35.491142 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-ea418407-e49e-40c5-aba0-3f4df0230c87 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:35.492190 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-ea418407-e49e-40c5-aba0-3f4df0230c87 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:35.501108 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ea418407-e49e-40c5-aba0-3f4df0230c87 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:35.501646 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ea418407-e49e-40c5-aba0-3f4df0230c87 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:35.502583 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ea418407-e49e-40c5-aba0-3f4df0230c87 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:35.503248 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ea418407-e49e-40c5-aba0-3f4df0230c87 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:37.823803 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-ea418407-e49e-40c5-aba0-3f4df0230c87 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 33662 microversion: 2.1 time: 2.337037 Dec 14 10:10:37.828200 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 156/332] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:35 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 33662 bytes in 2339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:10:37.830259 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-87f5b4ad-7de5-4742-868a-419bec25e99b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:37.830957 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-87f5b4ad-7de5-4742-868a-419bec25e99b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:37.838702 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-87f5b4ad-7de5-4742-868a-419bec25e99b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:37.839152 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-87f5b4ad-7de5-4742-868a-419bec25e99b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:37.839923 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-87f5b4ad-7de5-4742-868a-419bec25e99b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:37.840377 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-87f5b4ad-7de5-4742-868a-419bec25e99b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:38.052221 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-87f5b4ad-7de5-4742-868a-419bec25e99b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:38.062109 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-87f5b4ad-7de5-4742-868a-419bec25e99b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.235592 Dec 14 10:10:38.062692 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 157/333] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:37 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:38.835984 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-1b78a4a3-2eba-4e90-938f-099053bb8c0c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:38.837642 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-1b78a4a3-2eba-4e90-938f-099053bb8c0c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:38.846461 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1b78a4a3-2eba-4e90-938f-099053bb8c0c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:38.847158 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1b78a4a3-2eba-4e90-938f-099053bb8c0c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:38.848153 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1b78a4a3-2eba-4e90-938f-099053bb8c0c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:38.848768 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1b78a4a3-2eba-4e90-938f-099053bb8c0c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:38.963575 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-1b78a4a3-2eba-4e90-938f-099053bb8c0c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 34200 microversion: 2.1 time: 0.131074 Dec 14 10:10:38.964750 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 158/334] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:38 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 34200 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:10:39.080479 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-94095717-676c-4105-b84e-2de0e4a6750e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:39.081225 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-94095717-676c-4105-b84e-2de0e4a6750e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:39.090599 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-94095717-676c-4105-b84e-2de0e4a6750e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:39.091031 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-94095717-676c-4105-b84e-2de0e4a6750e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:39.091722 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-94095717-676c-4105-b84e-2de0e4a6750e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:39.092192 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-94095717-676c-4105-b84e-2de0e4a6750e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:39.288402 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-94095717-676c-4105-b84e-2de0e4a6750e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:39.296561 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-94095717-676c-4105-b84e-2de0e4a6750e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.221328 Dec 14 10:10:39.297116 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 159/335] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:39 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:10:39.975535 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-fab4d5c3-6331-43ef-bab7-8225bdda19c0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:39.976517 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-fab4d5c3-6331-43ef-bab7-8225bdda19c0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:39.986643 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fab4d5c3-6331-43ef-bab7-8225bdda19c0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:39.987205 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fab4d5c3-6331-43ef-bab7-8225bdda19c0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:39.987870 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fab4d5c3-6331-43ef-bab7-8225bdda19c0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:39.988414 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fab4d5c3-6331-43ef-bab7-8225bdda19c0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:40.118308 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-fab4d5c3-6331-43ef-bab7-8225bdda19c0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 34778 microversion: 2.1 time: 0.146043 Dec 14 10:10:40.118975 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 160/336] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:39 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 34778 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:10:40.313062 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-0da1c8f2-afc4-4305-8e3c-8b3619acb97f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:40.313774 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-0da1c8f2-afc4-4305-8e3c-8b3619acb97f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:40.321534 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0da1c8f2-afc4-4305-8e3c-8b3619acb97f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:40.321999 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0da1c8f2-afc4-4305-8e3c-8b3619acb97f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:40.322818 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0da1c8f2-afc4-4305-8e3c-8b3619acb97f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:40.323223 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0da1c8f2-afc4-4305-8e3c-8b3619acb97f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:40.537842 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-0da1c8f2-afc4-4305-8e3c-8b3619acb97f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:40.550921 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-0da1c8f2-afc4-4305-8e3c-8b3619acb97f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.241924 Dec 14 10:10:40.551590 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 161/337] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:40 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:10:41.130665 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-2d542b04-aaf5-4163-9b2e-7079d02e5f5b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:41.131512 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-2d542b04-aaf5-4163-9b2e-7079d02e5f5b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:41.139165 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2d542b04-aaf5-4163-9b2e-7079d02e5f5b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:41.139643 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2d542b04-aaf5-4163-9b2e-7079d02e5f5b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:41.140926 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2d542b04-aaf5-4163-9b2e-7079d02e5f5b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:41.141538 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2d542b04-aaf5-4163-9b2e-7079d02e5f5b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:41.271322 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-2d542b04-aaf5-4163-9b2e-7079d02e5f5b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 35552 microversion: 2.1 time: 0.144747 Dec 14 10:10:41.272214 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 162/338] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:41 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 35552 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:10:41.585314 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a84b156e-7ad4-4895-be5e-a1ff1cd985df tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:41.586145 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a84b156e-7ad4-4895-be5e-a1ff1cd985df tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:41.594929 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a84b156e-7ad4-4895-be5e-a1ff1cd985df tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:41.595493 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a84b156e-7ad4-4895-be5e-a1ff1cd985df tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:41.596462 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a84b156e-7ad4-4895-be5e-a1ff1cd985df tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:41.597304 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a84b156e-7ad4-4895-be5e-a1ff1cd985df tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:41.932004 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-a84b156e-7ad4-4895-be5e-a1ff1cd985df tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:41.941767 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a84b156e-7ad4-4895-be5e-a1ff1cd985df tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.360938 Dec 14 10:10:41.942356 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 163/339] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:41 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:42.285125 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-5df4e150-3090-4e2c-93d9-79626e9db03d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:42.286530 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-5df4e150-3090-4e2c-93d9-79626e9db03d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:42.296692 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5df4e150-3090-4e2c-93d9-79626e9db03d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:42.297157 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5df4e150-3090-4e2c-93d9-79626e9db03d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:42.298117 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5df4e150-3090-4e2c-93d9-79626e9db03d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:42.298717 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5df4e150-3090-4e2c-93d9-79626e9db03d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:42.406977 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.network.neutron [None req-6a97b901-3d48-4a4f-85d1-a5a7d2fa68c6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] validate_networks() for [('fcd0582b-f091-4bb6-bfce-2519464100b0', None, None, None)] {{(pid=100984) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:10:42.445911 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-5df4e150-3090-4e2c-93d9-79626e9db03d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 36334 microversion: 2.1 time: 0.166164 Dec 14 10:10:42.447338 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 164/340] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:42 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 36334 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:10:42.960243 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6d776d0c-793b-466f-8aea-fa5daa27563d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:42.961077 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6d776d0c-793b-466f-8aea-fa5daa27563d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:42.975871 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6d776d0c-793b-466f-8aea-fa5daa27563d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:42.977587 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6d776d0c-793b-466f-8aea-fa5daa27563d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:42.978766 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6d776d0c-793b-466f-8aea-fa5daa27563d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:42.979534 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6d776d0c-793b-466f-8aea-fa5daa27563d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:43.061597 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-6a97b901-3d48-4a4f-85d1-a5a7d2fa68c6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Flavor limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:10:43.062265 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-6a97b901-3d48-4a4f-85d1-a5a7d2fa68c6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Image limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:10:43.063727 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-6a97b901-3d48-4a4f-85d1-a5a7d2fa68c6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Flavor pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:10:43.064492 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-6a97b901-3d48-4a4f-85d1-a5a7d2fa68c6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Image pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:10:43.065224 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-6a97b901-3d48-4a4f-85d1-a5a7d2fa68c6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:10:43.077171 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6a97b901-3d48-4a4f-85d1-a5a7d2fa68c6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:43.078700 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6a97b901-3d48-4a4f-85d1-a5a7d2fa68c6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:43.080049 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6a97b901-3d48-4a4f-85d1-a5a7d2fa68c6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:43.080631 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6a97b901-3d48-4a4f-85d1-a5a7d2fa68c6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:43.103735 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-6a97b901-3d48-4a4f-85d1-a5a7d2fa68c6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Getting quotas for project 55d21e35946242e9b067686ed5f812ac. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:10:43.108909 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-6a97b901-3d48-4a4f-85d1-a5a7d2fa68c6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Getting quotas for user 61ac29796a444ae88d119870a479baa9 and project 55d21e35946242e9b067686ed5f812ac. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:10:43.121637 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-6a97b901-3d48-4a4f-85d1-a5a7d2fa68c6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Going to run 1 instances... {{(pid=100984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:10:43.124826 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-6a97b901-3d48-4a4f-85d1-a5a7d2fa68c6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5be36fdc-2baa-4efd-b830-5a5c3fd7beba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:10:43.230707 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-6a97b901-3d48-4a4f-85d1-a5a7d2fa68c6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 21.962250 Dec 14 10:10:43.231672 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 177/341] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Dec 14 10:10:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 21964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 10:10:43.240896 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-0b3b8597-ceb6-4223-9c7b-74ba769d8db9 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:43.241486 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-0b3b8597-ceb6-4223-9c7b-74ba769d8db9 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:43.345142 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-6d776d0c-793b-466f-8aea-fa5daa27563d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:43.348741 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-0b3b8597-ceb6-4223-9c7b-74ba769d8db9 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:43.359987 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-0b3b8597-ceb6-4223-9c7b-74ba769d8db9 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 200 len: 1217 microversion: 2.1 time: 0.122522 Dec 14 10:10:43.361333 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6d776d0c-793b-466f-8aea-fa5daa27563d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.406256 Dec 14 10:10:43.362024 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 178/342] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:43 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 1217 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:10:43.362599 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 165/343] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:42 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:43.459029 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-df5d7aed-efdf-4da1-b63f-5c62b088009b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:43.459995 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-df5d7aed-efdf-4da1-b63f-5c62b088009b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:43.468726 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-df5d7aed-efdf-4da1-b63f-5c62b088009b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:43.470835 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-df5d7aed-efdf-4da1-b63f-5c62b088009b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:43.473518 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-df5d7aed-efdf-4da1-b63f-5c62b088009b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:43.474308 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-df5d7aed-efdf-4da1-b63f-5c62b088009b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:43.614259 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-df5d7aed-efdf-4da1-b63f-5c62b088009b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 37122 microversion: 2.1 time: 0.159020 Dec 14 10:10:43.614904 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 179/344] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:43 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 37122 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:10:44.385427 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6a900037-b39b-4571-8e5c-176ddaf594d1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:44.386862 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-b49930e0-8cb6-45a6-beb3-5fac1ab4a070 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:44.387722 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-b49930e0-8cb6-45a6-beb3-5fac1ab4a070 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:44.388418 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6a900037-b39b-4571-8e5c-176ddaf594d1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:44.396650 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6a900037-b39b-4571-8e5c-176ddaf594d1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:44.397097 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6a900037-b39b-4571-8e5c-176ddaf594d1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:44.397881 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6a900037-b39b-4571-8e5c-176ddaf594d1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:44.408228 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b49930e0-8cb6-45a6-beb3-5fac1ab4a070 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:44.408747 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b49930e0-8cb6-45a6-beb3-5fac1ab4a070 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:44.409580 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b49930e0-8cb6-45a6-beb3-5fac1ab4a070 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:44.410053 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b49930e0-8cb6-45a6-beb3-5fac1ab4a070 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:44.413781 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6a900037-b39b-4571-8e5c-176ddaf594d1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:44.550043 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-b49930e0-8cb6-45a6-beb3-5fac1ab4a070 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:44.559512 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-b49930e0-8cb6-45a6-beb3-5fac1ab4a070 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 200 len: 1269 microversion: 2.1 time: 0.181602 Dec 14 10:10:44.560293 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 180/345] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:44 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 1269 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:44.627280 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f7c9f328-4aa9-46c1-b009-77f3dcd1cde5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:44.628189 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f7c9f328-4aa9-46c1-b009-77f3dcd1cde5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:44.635713 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f7c9f328-4aa9-46c1-b009-77f3dcd1cde5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:44.635971 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f7c9f328-4aa9-46c1-b009-77f3dcd1cde5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:44.637192 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f7c9f328-4aa9-46c1-b009-77f3dcd1cde5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:44.637605 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f7c9f328-4aa9-46c1-b009-77f3dcd1cde5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:44.648063 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-6a900037-b39b-4571-8e5c-176ddaf594d1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:44.657337 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6a900037-b39b-4571-8e5c-176ddaf594d1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.282039 Dec 14 10:10:44.658268 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 166/346] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:44 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:44.769146 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f7c9f328-4aa9-46c1-b009-77f3dcd1cde5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 37918 microversion: 2.1 time: 0.145637 Dec 14 10:10:44.769768 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 181/347] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:44 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 37918 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:10:45.578266 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-d04c3cf4-0545-42dd-9f58-586dc838243d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:45.578858 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-d04c3cf4-0545-42dd-9f58-586dc838243d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:45.593569 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d04c3cf4-0545-42dd-9f58-586dc838243d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:45.594285 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d04c3cf4-0545-42dd-9f58-586dc838243d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:45.596380 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d04c3cf4-0545-42dd-9f58-586dc838243d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:45.596990 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d04c3cf4-0545-42dd-9f58-586dc838243d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:45.675909 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5faf43cd-09a6-42c9-bc35-b9d3df747d0f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:45.677279 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5faf43cd-09a6-42c9-bc35-b9d3df747d0f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:45.693449 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5faf43cd-09a6-42c9-bc35-b9d3df747d0f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:45.694228 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5faf43cd-09a6-42c9-bc35-b9d3df747d0f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:45.695191 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5faf43cd-09a6-42c9-bc35-b9d3df747d0f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:45.698221 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5faf43cd-09a6-42c9-bc35-b9d3df747d0f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:45.786156 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-d04c3cf4-0545-42dd-9f58-586dc838243d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:45.801180 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-d04c3cf4-0545-42dd-9f58-586dc838243d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 200 len: 1275 microversion: 2.1 time: 0.223816 Dec 14 10:10:45.801794 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 167/348] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:45 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 1275 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:45.808789 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e22c9fc7-53c7-441b-a5c5-9db50c2ca4da tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:45.811316 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e22c9fc7-53c7-441b-a5c5-9db50c2ca4da tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:45.824596 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e22c9fc7-53c7-441b-a5c5-9db50c2ca4da tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:45.825232 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e22c9fc7-53c7-441b-a5c5-9db50c2ca4da tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:45.826304 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e22c9fc7-53c7-441b-a5c5-9db50c2ca4da tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:45.827370 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e22c9fc7-53c7-441b-a5c5-9db50c2ca4da tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:45.974411 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5faf43cd-09a6-42c9-bc35-b9d3df747d0f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:45.980067 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e22c9fc7-53c7-441b-a5c5-9db50c2ca4da tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 38400 microversion: 2.1 time: 0.176018 Dec 14 10:10:45.981153 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 168/349] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:45 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 38400 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:10:45.990399 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5faf43cd-09a6-42c9-bc35-b9d3df747d0f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1501 microversion: 2.1 time: 0.318189 Dec 14 10:10:45.994669 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 182/350] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:45 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1501 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:10:46.012281 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-1eaadccb-6671-4c20-b7ea-59c9b49e1972 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1a2c24f-2f6f-47b8-802d-eb49db3b3d6d"}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:46.013705 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-1eaadccb-6671-4c20-b7ea-59c9b49e1972 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:46.023519 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1eaadccb-6671-4c20-b7ea-59c9b49e1972 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:46.024209 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1eaadccb-6671-4c20-b7ea-59c9b49e1972 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:46.025456 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1eaadccb-6671-4c20-b7ea-59c9b49e1972 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:46.026600 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1eaadccb-6671-4c20-b7ea-59c9b49e1972 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:46.096516 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-1eaadccb-6671-4c20-b7ea-59c9b49e1972 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] HTTP exception thrown: Cannot 'attach_volume' instance 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd while it is in vm_state rescued Dec 14 10:10:46.097418 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-1eaadccb-6671-4c20-b7ea-59c9b49e1972 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Returning 409 to user: Cannot 'attach_volume' instance 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd while it is in vm_state rescued {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:10:46.098582 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-1eaadccb-6671-4c20-b7ea-59c9b49e1972 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "POST /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.091001 Dec 14 10:10:46.099198 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 169/351] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Dec 14 10:10:46 2021] POST /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/os-volume_attachments => generated 152 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 14 10:10:46.109495 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-fba44077-8d1c-40e0-8744-63dde33bc8e7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:46.110735 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-fba44077-8d1c-40e0-8744-63dde33bc8e7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:46.119664 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fba44077-8d1c-40e0-8744-63dde33bc8e7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:46.120298 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fba44077-8d1c-40e0-8744-63dde33bc8e7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:46.121942 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fba44077-8d1c-40e0-8744-63dde33bc8e7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:46.122388 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fba44077-8d1c-40e0-8744-63dde33bc8e7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:46.287356 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-fba44077-8d1c-40e0-8744-63dde33bc8e7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "POST /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/action" status: 202 len: 0 microversion: 2.1 time: 0.183029 Dec 14 10:10:46.288548 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 183/352] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:46 2021] POST /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 14 10:10:46.297192 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-eb306f8b-b8c6-4fb5-864c-829eb7f3610d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:46.297809 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-eb306f8b-b8c6-4fb5-864c-829eb7f3610d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:46.306204 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-eb306f8b-b8c6-4fb5-864c-829eb7f3610d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:46.306593 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-eb306f8b-b8c6-4fb5-864c-829eb7f3610d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:46.307673 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-eb306f8b-b8c6-4fb5-864c-829eb7f3610d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:46.308114 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-eb306f8b-b8c6-4fb5-864c-829eb7f3610d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:46.829124 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-b8f3fa11-a6a6-4e52-b4cc-2688dc1b0f7d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:46.829744 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-b8f3fa11-a6a6-4e52-b4cc-2688dc1b0f7d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:46.858493 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b8f3fa11-a6a6-4e52-b4cc-2688dc1b0f7d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:46.862104 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b8f3fa11-a6a6-4e52-b4cc-2688dc1b0f7d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:46.864426 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b8f3fa11-a6a6-4e52-b4cc-2688dc1b0f7d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:46.864856 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b8f3fa11-a6a6-4e52-b4cc-2688dc1b0f7d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:46.944065 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-eb306f8b-b8c6-4fb5-864c-829eb7f3610d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:46.957318 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-eb306f8b-b8c6-4fb5-864c-829eb7f3610d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1509 microversion: 2.1 time: 0.664271 Dec 14 10:10:46.970319 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 170/353] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:46 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1509 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:46.992594 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6b07b46b-2e52-41fd-87ec-2d0824c95b20 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:46.993506 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6b07b46b-2e52-41fd-87ec-2d0824c95b20 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:47.006304 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6b07b46b-2e52-41fd-87ec-2d0824c95b20 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:47.007874 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6b07b46b-2e52-41fd-87ec-2d0824c95b20 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:47.009162 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6b07b46b-2e52-41fd-87ec-2d0824c95b20 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:47.015007 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6b07b46b-2e52-41fd-87ec-2d0824c95b20 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:47.168584 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6b07b46b-2e52-41fd-87ec-2d0824c95b20 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 38557 microversion: 2.1 time: 0.179446 Dec 14 10:10:47.169233 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 171/354] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:46 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 38557 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:10:47.316389 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-b8f3fa11-a6a6-4e52-b4cc-2688dc1b0f7d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:47.325482 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-b8f3fa11-a6a6-4e52-b4cc-2688dc1b0f7d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 200 len: 1317 microversion: 2.1 time: 0.510243 Dec 14 10:10:47.326407 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 184/355] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:46 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:47.397564 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-aa86b119-c172-46a2-9982-6ced97112162 req-0d7ac969-2b83-4fc9-b8ed-88a5706cf97a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2cb221d-d3cd-4592-8e0b-479868639222", "tag": "0e286880-f0f3-4450-b612-5e78ff43dd02"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:47.399054 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:10:47.399054 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:10:47.408643 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-aa86b119-c172-46a2-9982-6ced97112162 req-0d7ac969-2b83-4fc9-b8ed-88a5706cf97a service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:47.409100 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-aa86b119-c172-46a2-9982-6ced97112162 req-0d7ac969-2b83-4fc9-b8ed-88a5706cf97a service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:47.429238 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-aa86b119-c172-46a2-9982-6ced97112162 req-0d7ac969-2b83-4fc9-b8ed-88a5706cf97a service nova] Creating event network-changed:0e286880-f0f3-4450-b612-5e78ff43dd02 for instance b2cb221d-d3cd-4592-8e0b-479868639222 on hv-cinder-81888 Dec 14 10:10:47.436416 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-aa86b119-c172-46a2-9982-6ced97112162 req-0d7ac969-2b83-4fc9-b8ed-88a5706cf97a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043130 Dec 14 10:10:47.437508 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 172/356] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:10:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:10:47.977376 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-b70bac26-b718-42e8-b557-c5d2e0a4ed70 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:47.978103 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-b70bac26-b718-42e8-b557-c5d2e0a4ed70 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:47.995119 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b70bac26-b718-42e8-b557-c5d2e0a4ed70 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:47.995804 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b70bac26-b718-42e8-b557-c5d2e0a4ed70 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:47.996973 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b70bac26-b718-42e8-b557-c5d2e0a4ed70 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:47.997589 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b70bac26-b718-42e8-b557-c5d2e0a4ed70 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:48.225436 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c16295a9-c117-4293-ba14-3f7a5548951a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:48.227626 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c16295a9-c117-4293-ba14-3f7a5548951a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:48.238135 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c16295a9-c117-4293-ba14-3f7a5548951a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:48.238783 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c16295a9-c117-4293-ba14-3f7a5548951a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:48.239560 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c16295a9-c117-4293-ba14-3f7a5548951a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:48.240055 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c16295a9-c117-4293-ba14-3f7a5548951a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:48.268809 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-b70bac26-b718-42e8-b557-c5d2e0a4ed70 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:48.282592 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-b70bac26-b718-42e8-b557-c5d2e0a4ed70 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1509 microversion: 2.1 time: 0.309055 Dec 14 10:10:48.283168 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 185/357] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:47 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1509 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:48.341976 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-768aed5f-2d13-4a17-afbd-cc7c020c333a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:48.342818 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-768aed5f-2d13-4a17-afbd-cc7c020c333a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:48.352268 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-768aed5f-2d13-4a17-afbd-cc7c020c333a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:48.353385 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-768aed5f-2d13-4a17-afbd-cc7c020c333a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:48.354412 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-768aed5f-2d13-4a17-afbd-cc7c020c333a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:48.354988 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-768aed5f-2d13-4a17-afbd-cc7c020c333a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:48.379271 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c16295a9-c117-4293-ba14-3f7a5548951a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 200 len: 38688 microversion: 2.1 time: 0.158121 Dec 14 10:10:48.384442 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 173/358] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:10:48 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 38688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:10:48.399155 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b92304e3-f0fa-49af-8798-aaa37e9666f0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:48.400349 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-b92304e3-f0fa-49af-8798-aaa37e9666f0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:48.415137 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b92304e3-f0fa-49af-8798-aaa37e9666f0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:48.415584 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b92304e3-f0fa-49af-8798-aaa37e9666f0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:48.416359 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b92304e3-f0fa-49af-8798-aaa37e9666f0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:48.416790 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b92304e3-f0fa-49af-8798-aaa37e9666f0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:48.520951 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-b92304e3-f0fa-49af-8798-aaa37e9666f0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/ips" status: 200 len: 146 microversion: 2.1 time: 0.129691 Dec 14 10:10:48.521534 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 174/359] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Dec 14 10:10:48 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/ips => generated 146 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:10:48.658285 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-768aed5f-2d13-4a17-afbd-cc7c020c333a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:48.667826 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-768aed5f-2d13-4a17-afbd-cc7c020c333a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 200 len: 1317 microversion: 2.1 time: 0.329808 Dec 14 10:10:48.669474 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 186/360] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:48 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:10:49.300614 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f1f05be7-bce9-4eee-b5d0-6fc6115095cc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:49.301158 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f1f05be7-bce9-4eee-b5d0-6fc6115095cc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:49.308307 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f1f05be7-bce9-4eee-b5d0-6fc6115095cc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:49.308752 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f1f05be7-bce9-4eee-b5d0-6fc6115095cc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:49.309513 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f1f05be7-bce9-4eee-b5d0-6fc6115095cc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:49.309945 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f1f05be7-bce9-4eee-b5d0-6fc6115095cc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:49.514294 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f1f05be7-bce9-4eee-b5d0-6fc6115095cc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:49.524430 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f1f05be7-bce9-4eee-b5d0-6fc6115095cc tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1509 microversion: 2.1 time: 0.227467 Dec 14 10:10:49.525488 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 175/361] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:49 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1509 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:10:49.684385 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-bdbb4326-a03b-4af5-8fc2-83c0f2baa9a5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:49.685686 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-bdbb4326-a03b-4af5-8fc2-83c0f2baa9a5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:49.694284 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bdbb4326-a03b-4af5-8fc2-83c0f2baa9a5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:49.694841 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bdbb4326-a03b-4af5-8fc2-83c0f2baa9a5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:49.695678 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bdbb4326-a03b-4af5-8fc2-83c0f2baa9a5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:49.696318 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bdbb4326-a03b-4af5-8fc2-83c0f2baa9a5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:49.821708 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-815ee9ff-21c3-4a0a-91f6-6d5efd38ffee tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6c6f9ff-165a-43b3-b1fa-ff35dec76c5a", "device": "/dev/sdb"}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:49.825502 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-815ee9ff-21c3-4a0a-91f6-6d5efd38ffee tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:49.839660 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-815ee9ff-21c3-4a0a-91f6-6d5efd38ffee tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:49.840205 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-815ee9ff-21c3-4a0a-91f6-6d5efd38ffee tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:49.841063 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-815ee9ff-21c3-4a0a-91f6-6d5efd38ffee tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:49.841578 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-815ee9ff-21c3-4a0a-91f6-6d5efd38ffee tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:49.938878 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-bdbb4326-a03b-4af5-8fc2-83c0f2baa9a5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:49.948762 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-bdbb4326-a03b-4af5-8fc2-83c0f2baa9a5 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 200 len: 1317 microversion: 2.1 time: 0.268030 Dec 14 10:10:49.949330 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 187/362] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:49 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:50.542298 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-815ee9ff-21c3-4a0a-91f6-6d5efd38ffee tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "POST /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.728108 Dec 14 10:10:50.543832 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 176/363] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Dec 14 10:10:49 2021] POST /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df/os-volume_attachments => generated 194 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:10:50.543972 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-6eb6a489-e5a3-4252-99be-bdb5eab70241 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:50.544639 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-6eb6a489-e5a3-4252-99be-bdb5eab70241 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:50.552761 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6eb6a489-e5a3-4252-99be-bdb5eab70241 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:50.553206 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6eb6a489-e5a3-4252-99be-bdb5eab70241 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:50.555435 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6eb6a489-e5a3-4252-99be-bdb5eab70241 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:50.556224 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6eb6a489-e5a3-4252-99be-bdb5eab70241 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:50.853724 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-6eb6a489-e5a3-4252-99be-bdb5eab70241 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:50.864441 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-6eb6a489-e5a3-4252-99be-bdb5eab70241 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1515 microversion: 2.1 time: 0.325549 Dec 14 10:10:50.865032 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 188/364] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:50 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1515 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:10:50.972845 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-0891895b-138d-4adf-b2ea-4a2c47f90858 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:50.973541 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-0891895b-138d-4adf-b2ea-4a2c47f90858 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:50.985037 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0891895b-138d-4adf-b2ea-4a2c47f90858 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:50.985472 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0891895b-138d-4adf-b2ea-4a2c47f90858 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:50.986505 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0891895b-138d-4adf-b2ea-4a2c47f90858 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:50.986950 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0891895b-138d-4adf-b2ea-4a2c47f90858 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:51.247739 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-0891895b-138d-4adf-b2ea-4a2c47f90858 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:51.259655 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-0891895b-138d-4adf-b2ea-4a2c47f90858 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 200 len: 1317 microversion: 2.1 time: 0.293932 Dec 14 10:10:51.260855 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 177/365] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:50 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:52.277585 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a1faef59-ffcf-4976-85f8-3fff220ecc4f tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:52.278340 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-a1faef59-ffcf-4976-85f8-3fff220ecc4f tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:52.286277 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a1faef59-ffcf-4976-85f8-3fff220ecc4f tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:52.286725 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a1faef59-ffcf-4976-85f8-3fff220ecc4f tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:52.287494 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a1faef59-ffcf-4976-85f8-3fff220ecc4f tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:52.287922 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a1faef59-ffcf-4976-85f8-3fff220ecc4f tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:52.657505 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-a1faef59-ffcf-4976-85f8-3fff220ecc4f tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:52.665396 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a1faef59-ffcf-4976-85f8-3fff220ecc4f tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 200 len: 1317 microversion: 2.1 time: 0.391767 Dec 14 10:10:52.665983 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 189/366] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:52 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:53.683411 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-bc29a929-271c-4b4f-9b6c-c93a537adf73 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:53.684025 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-bc29a929-271c-4b4f-9b6c-c93a537adf73 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:53.693090 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bc29a929-271c-4b4f-9b6c-c93a537adf73 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:53.693550 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bc29a929-271c-4b4f-9b6c-c93a537adf73 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:53.694370 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bc29a929-271c-4b4f-9b6c-c93a537adf73 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:53.694810 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bc29a929-271c-4b4f-9b6c-c93a537adf73 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:54.045775 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-bc29a929-271c-4b4f-9b6c-c93a537adf73 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:54.060401 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-bc29a929-271c-4b4f-9b6c-c93a537adf73 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 200 len: 1317 microversion: 2.1 time: 0.381174 Dec 14 10:10:54.061543 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 178/367] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:53 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:55.080217 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-965c9b23-3fd1-49b0-a8c1-0be4a906bc20 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:55.082083 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-965c9b23-3fd1-49b0-a8c1-0be4a906bc20 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:55.093589 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-965c9b23-3fd1-49b0-a8c1-0be4a906bc20 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:55.094102 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-965c9b23-3fd1-49b0-a8c1-0be4a906bc20 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:55.094926 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-965c9b23-3fd1-49b0-a8c1-0be4a906bc20 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:55.095448 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-965c9b23-3fd1-49b0-a8c1-0be4a906bc20 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:55.114500 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-43e00130-84a1-4566-b67d-f41cfca04897 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38fd60c6-b773-4003-a052-a65574d1604b"}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:55.116281 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-43e00130-84a1-4566-b67d-f41cfca04897 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:55.126487 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-43e00130-84a1-4566-b67d-f41cfca04897 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:55.127610 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-43e00130-84a1-4566-b67d-f41cfca04897 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:55.128883 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-43e00130-84a1-4566-b67d-f41cfca04897 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:55.129657 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-43e00130-84a1-4566-b67d-f41cfca04897 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:55.389444 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-965c9b23-3fd1-49b0-a8c1-0be4a906bc20 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:55.397537 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-965c9b23-3fd1-49b0-a8c1-0be4a906bc20 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 200 len: 1317 microversion: 2.1 time: 0.323627 Dec 14 10:10:55.398483 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 190/368] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:55 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:55.614432 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-43e00130-84a1-4566-b67d-f41cfca04897 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.503875 Dec 14 10:10:55.615224 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 179/369] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Dec 14 10:10:55 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/os-volume_attachments => generated 194 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:10:55.790341 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-0b3e6cb6-f956-4829-9ee0-4875f3b7dfd1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:55.791080 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-0b3e6cb6-f956-4829-9ee0-4875f3b7dfd1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:55.818909 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0b3e6cb6-f956-4829-9ee0-4875f3b7dfd1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:55.819722 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0b3e6cb6-f956-4829-9ee0-4875f3b7dfd1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:55.820735 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0b3e6cb6-f956-4829-9ee0-4875f3b7dfd1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:55.821624 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0b3e6cb6-f956-4829-9ee0-4875f3b7dfd1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:56.183833 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-0b3e6cb6-f956-4829-9ee0-4875f3b7dfd1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:56.192611 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-0b3e6cb6-f956-4829-9ee0-4875f3b7dfd1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1515 microversion: 2.1 time: 0.406387 Dec 14 10:10:56.203479 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 191/370] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:55 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1515 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:56.212812 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-7176ca60-a32a-43c3-97cc-aebddfe34716 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f71d54b6-0d2a-4075-90fe-81d02953deae"}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:56.214040 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-7176ca60-a32a-43c3-97cc-aebddfe34716 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:56.224411 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7176ca60-a32a-43c3-97cc-aebddfe34716 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:56.225048 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7176ca60-a32a-43c3-97cc-aebddfe34716 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:56.225988 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7176ca60-a32a-43c3-97cc-aebddfe34716 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:56.226570 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7176ca60-a32a-43c3-97cc-aebddfe34716 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:56.366856 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-1f7b1a15-6230-49ab-84d1-cadde3d8261d req-4dd85edb-56ab-4712-b09d-9c4088313298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2cb221d-d3cd-4592-8e0b-479868639222", "name": "network-vif-plugged", "status": "completed", "tag": "0e286880-f0f3-4450-b612-5e78ff43dd02"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:10:56.368779 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:10:56.368779 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:10:56.389854 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-1f7b1a15-6230-49ab-84d1-cadde3d8261d req-4dd85edb-56ab-4712-b09d-9c4088313298 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:56.390236 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-1f7b1a15-6230-49ab-84d1-cadde3d8261d req-4dd85edb-56ab-4712-b09d-9c4088313298 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:56.439115 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-1f7b1a15-6230-49ab-84d1-cadde3d8261d req-4dd85edb-56ab-4712-b09d-9c4088313298 service nova] Creating event network-vif-plugged:0e286880-f0f3-4450-b612-5e78ff43dd02 for instance b2cb221d-d3cd-4592-8e0b-479868639222 on hv-cinder-81888 Dec 14 10:10:56.477938 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-1f7b1a15-6230-49ab-84d1-cadde3d8261d req-4dd85edb-56ab-4712-b09d-9c4088313298 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113148 Dec 14 10:10:56.478648 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 192/371] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:10:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:10:56.499063 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5d123db2-0b2d-4599-9701-53ea74214ff6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:56.500406 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5d123db2-0b2d-4599-9701-53ea74214ff6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:56.508511 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5d123db2-0b2d-4599-9701-53ea74214ff6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:56.509379 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5d123db2-0b2d-4599-9701-53ea74214ff6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:56.510383 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5d123db2-0b2d-4599-9701-53ea74214ff6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:56.511007 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5d123db2-0b2d-4599-9701-53ea74214ff6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:56.851273 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-7176ca60-a32a-43c3-97cc-aebddfe34716 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "POST /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.640291 Dec 14 10:10:56.862172 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 180/372] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Dec 14 10:10:56 2021] POST /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/os-volume_attachments => generated 194 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:10:56.931895 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5d123db2-0b2d-4599-9701-53ea74214ff6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:56.945111 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5d123db2-0b2d-4599-9701-53ea74214ff6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 200 len: 1317 microversion: 2.1 time: 0.460287 Dec 14 10:10:56.956585 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 193/373] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:56 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 1317 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:10:57.963429 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-554b8af8-ee2b-4a56-b2bf-b9fcb89201ec tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:57.964908 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-554b8af8-ee2b-4a56-b2bf-b9fcb89201ec tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:57.974410 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-554b8af8-ee2b-4a56-b2bf-b9fcb89201ec tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:57.975260 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-554b8af8-ee2b-4a56-b2bf-b9fcb89201ec tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:57.976146 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-554b8af8-ee2b-4a56-b2bf-b9fcb89201ec tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:57.976846 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-554b8af8-ee2b-4a56-b2bf-b9fcb89201ec tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:58.522555 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-554b8af8-ee2b-4a56-b2bf-b9fcb89201ec tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:58.536292 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-554b8af8-ee2b-4a56-b2bf-b9fcb89201ec tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 200 len: 1317 microversion: 2.1 time: 0.577028 Dec 14 10:10:58.552794 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 181/374] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:57 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 1317 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:10:59.566114 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-695ab86b-f21a-4d7a-b31c-5aca1749f4e6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:10:59.566817 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-695ab86b-f21a-4d7a-b31c-5aca1749f4e6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:10:59.574186 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-695ab86b-f21a-4d7a-b31c-5aca1749f4e6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:59.574699 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-695ab86b-f21a-4d7a-b31c-5aca1749f4e6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:59.575529 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-695ab86b-f21a-4d7a-b31c-5aca1749f4e6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:10:59.576081 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-695ab86b-f21a-4d7a-b31c-5aca1749f4e6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:10:59.790140 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-695ab86b-f21a-4d7a-b31c-5aca1749f4e6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:10:59.803536 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-695ab86b-f21a-4d7a-b31c-5aca1749f4e6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 200 len: 1507 microversion: 2.1 time: 0.241462 Dec 14 10:10:59.804906 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 194/375] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:10:59 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:01.379844 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-30cfb007-c603-47bf-a8b4-15dfa9687127 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc8bba1b-c75e-4a19-97fa-a3b944a1ae7c"}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:01.381689 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-30cfb007-c603-47bf-a8b4-15dfa9687127 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:01.390931 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-30cfb007-c603-47bf-a8b4-15dfa9687127 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:01.391684 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-30cfb007-c603-47bf-a8b4-15dfa9687127 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:01.392733 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-30cfb007-c603-47bf-a8b4-15dfa9687127 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:01.393378 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-30cfb007-c603-47bf-a8b4-15dfa9687127 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:02.260780 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-30cfb007-c603-47bf-a8b4-15dfa9687127 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "POST /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.884008 Dec 14 10:11:02.261854 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 182/376] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Dec 14 10:11:01 2021] POST /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222/os-volume_attachments => generated 194 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:11:02.914900 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-2da3d651-0a39-4445-a9f2-77d0d219df1f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-832765952", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2076031675", "security_groups": [{"name": "tempest-secgroup-smoke-656520569"}], "networks": [{"uuid": "d59055ef-5180-470c-884a-72dc9abe1810"}], "block_device_mapping_v2": [{"uuid": "bcb12b14-5e50-4f48-97b1-f86dc3778930", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:03.234855 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.network.neutron [None req-2da3d651-0a39-4445-a9f2-77d0d219df1f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] validate_networks() for [('d59055ef-5180-470c-884a-72dc9abe1810', None, None, None)] {{(pid=100984) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:11:04.534610 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-2da3d651-0a39-4445-a9f2-77d0d219df1f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Flavor limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:11:04.535207 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-2da3d651-0a39-4445-a9f2-77d0d219df1f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Image limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:11:04.535962 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-2da3d651-0a39-4445-a9f2-77d0d219df1f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Flavor pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:11:04.536499 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-2da3d651-0a39-4445-a9f2-77d0d219df1f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Image pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:11:04.536974 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-2da3d651-0a39-4445-a9f2-77d0d219df1f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:11:04.546229 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2da3d651-0a39-4445-a9f2-77d0d219df1f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:04.546944 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2da3d651-0a39-4445-a9f2-77d0d219df1f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:04.547934 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2da3d651-0a39-4445-a9f2-77d0d219df1f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:04.548563 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2da3d651-0a39-4445-a9f2-77d0d219df1f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:04.571033 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-2da3d651-0a39-4445-a9f2-77d0d219df1f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Getting quotas for project a588cde51b9d45b2844c4ffc951dac41. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:11:04.578670 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-2da3d651-0a39-4445-a9f2-77d0d219df1f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Getting quotas for user 235d3d850d9e4d90bb29d5f891e23419 and project a588cde51b9d45b2844c4ffc951dac41. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:11:04.709484 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-2da3d651-0a39-4445-a9f2-77d0d219df1f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Going to run 1 instances... {{(pid=100984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:11:04.711813 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-2da3d651-0a39-4445-a9f2-77d0d219df1f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bcb12b14-5e50-4f48-97b1-f86dc3778930',volume_size=None,volume_type=None)] {{(pid=100984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:11:04.992815 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-2da3d651-0a39-4445-a9f2-77d0d219df1f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.080935 Dec 14 10:11:04.996368 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 195/377] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Dec 14 10:11:02 2021] POST /compute/v2.1/servers => generated 405 bytes in 2087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 10:11:05.007305 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-2ab7c642-732e-4f31-bfaa-64376c27192f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:05.007898 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-2ab7c642-732e-4f31-bfaa-64376c27192f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:05.193590 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-2ab7c642-732e-4f31-bfaa-64376c27192f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:05.202751 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-2ab7c642-732e-4f31-bfaa-64376c27192f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1088 microversion: 2.1 time: 0.201900 Dec 14 10:11:05.203338 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 183/378] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:04 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1088 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:06.225144 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e7917b90-b8c0-4541-9d81-c52efcc65dbc tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:06.227506 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e7917b90-b8c0-4541-9d81-c52efcc65dbc tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:06.238348 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e7917b90-b8c0-4541-9d81-c52efcc65dbc tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:06.238932 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e7917b90-b8c0-4541-9d81-c52efcc65dbc tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:06.239852 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e7917b90-b8c0-4541-9d81-c52efcc65dbc tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:06.240352 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e7917b90-b8c0-4541-9d81-c52efcc65dbc tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:06.546493 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e7917b90-b8c0-4541-9d81-c52efcc65dbc tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:06.593511 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e7917b90-b8c0-4541-9d81-c52efcc65dbc tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1130 microversion: 2.1 time: 0.368431 Dec 14 10:11:06.598613 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 196/379] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:06 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1130 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:07.610976 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-bc797125-4572-44b4-a022-ad0ab5b57285 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:07.612312 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-bc797125-4572-44b4-a022-ad0ab5b57285 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:07.621851 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bc797125-4572-44b4-a022-ad0ab5b57285 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:07.622533 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bc797125-4572-44b4-a022-ad0ab5b57285 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:07.623433 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bc797125-4572-44b4-a022-ad0ab5b57285 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:07.624016 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bc797125-4572-44b4-a022-ad0ab5b57285 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:08.011251 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-bc797125-4572-44b4-a022-ad0ab5b57285 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:08.027391 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-bc797125-4572-44b4-a022-ad0ab5b57285 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1204 microversion: 2.1 time: 0.420431 Dec 14 10:11:08.038418 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 184/380] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:07 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1204 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:09.046414 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-26f60208-d264-4f46-9297-744b04e1dc82 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:09.047592 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-26f60208-d264-4f46-9297-744b04e1dc82 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:09.055332 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-26f60208-d264-4f46-9297-744b04e1dc82 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:09.056349 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-26f60208-d264-4f46-9297-744b04e1dc82 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:09.057731 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-26f60208-d264-4f46-9297-744b04e1dc82 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:09.058361 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-26f60208-d264-4f46-9297-744b04e1dc82 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:09.202856 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-26f60208-d264-4f46-9297-744b04e1dc82 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:09.212718 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-26f60208-d264-4f46-9297-744b04e1dc82 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1204 microversion: 2.1 time: 0.170571 Dec 14 10:11:09.214270 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 197/381] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:09 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1204 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:10.230243 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-bf1d4996-dea8-4901-bc2c-feb6c57360bb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:10.231269 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-bf1d4996-dea8-4901-bc2c-feb6c57360bb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:10.240853 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bf1d4996-dea8-4901-bc2c-feb6c57360bb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:10.246274 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bf1d4996-dea8-4901-bc2c-feb6c57360bb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:10.248032 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bf1d4996-dea8-4901-bc2c-feb6c57360bb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:10.248689 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bf1d4996-dea8-4901-bc2c-feb6c57360bb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:10.386524 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-bf1d4996-dea8-4901-bc2c-feb6c57360bb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:10.419959 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-bf1d4996-dea8-4901-bc2c-feb6c57360bb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1204 microversion: 2.1 time: 0.192513 Dec 14 10:11:10.420603 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 185/382] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:10 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1204 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:11.437364 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8f24d713-abf5-4502-8aba-46c0932d6fe8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:11.438068 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-8f24d713-abf5-4502-8aba-46c0932d6fe8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:11.453498 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8f24d713-abf5-4502-8aba-46c0932d6fe8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:11.453945 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8f24d713-abf5-4502-8aba-46c0932d6fe8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:11.454758 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8f24d713-abf5-4502-8aba-46c0932d6fe8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:11.455293 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8f24d713-abf5-4502-8aba-46c0932d6fe8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:11.679865 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-8f24d713-abf5-4502-8aba-46c0932d6fe8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:11.697782 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8f24d713-abf5-4502-8aba-46c0932d6fe8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1204 microversion: 2.1 time: 0.264678 Dec 14 10:11:11.698713 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 198/383] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:11 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1204 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:12.714913 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e270ecac-1b66-4b41-be9e-ab214ba4d99a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:12.717073 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e270ecac-1b66-4b41-be9e-ab214ba4d99a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:12.729714 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e270ecac-1b66-4b41-be9e-ab214ba4d99a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:12.732893 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e270ecac-1b66-4b41-be9e-ab214ba4d99a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:12.738582 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e270ecac-1b66-4b41-be9e-ab214ba4d99a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:12.739549 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e270ecac-1b66-4b41-be9e-ab214ba4d99a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:13.176692 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d552c609-faa5-4a7a-b840-7a53790a5376 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:13.193948 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d552c609-faa5-4a7a-b840-7a53790a5376 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:13.193948 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d552c609-faa5-4a7a-b840-7a53790a5376 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:13.569457 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d552c609-faa5-4a7a-b840-7a53790a5376 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Going to try to stop instance {{(pid=100984) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Dec 14 10:11:13.742012 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d552c609-faa5-4a7a-b840-7a53790a5376 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 202 len: 0 microversion: 2.1 time: 0.554881 Dec 14 10:11:13.742012 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 199/384] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:11:13 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 14 10:11:13.772769 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5b457360-affa-498c-8ded-fc52a7aabc64 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:13.773779 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5b457360-affa-498c-8ded-fc52a7aabc64 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:13.797122 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5b457360-affa-498c-8ded-fc52a7aabc64 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:13.797122 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5b457360-affa-498c-8ded-fc52a7aabc64 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:13.797581 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5b457360-affa-498c-8ded-fc52a7aabc64 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:13.798005 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5b457360-affa-498c-8ded-fc52a7aabc64 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:13.841709 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-e270ecac-1b66-4b41-be9e-ab214ba4d99a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:13.868926 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e270ecac-1b66-4b41-be9e-ab214ba4d99a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1271 microversion: 2.1 time: 1.158308 Dec 14 10:11:13.870913 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 186/385] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:12 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1271 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:14.141278 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5b457360-affa-498c-8ded-fc52a7aabc64 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:14.152550 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5b457360-affa-498c-8ded-fc52a7aabc64 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.414536 Dec 14 10:11:14.167564 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 200/386] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:13 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:14.572240 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-4e065c0d-639a-4d70-8cb5-e9698a184683 req-dff33dd2-463f-43f3-ae2a-e12a8f0f1cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "731c99da-4633-4de9-9678-02e9fecda7b4", "tag": "eb309f74-48d9-4eb5-98e8-7571414fa330"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:14.585628 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:11:14.585628 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:11:14.597872 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-4e065c0d-639a-4d70-8cb5-e9698a184683 req-dff33dd2-463f-43f3-ae2a-e12a8f0f1cc5 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:14.598458 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-4e065c0d-639a-4d70-8cb5-e9698a184683 req-dff33dd2-463f-43f3-ae2a-e12a8f0f1cc5 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:14.616763 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-4e065c0d-639a-4d70-8cb5-e9698a184683 req-dff33dd2-463f-43f3-ae2a-e12a8f0f1cc5 service nova] Creating event network-changed:eb309f74-48d9-4eb5-98e8-7571414fa330 for instance 731c99da-4633-4de9-9678-02e9fecda7b4 on hv-cinder-81888 Dec 14 10:11:14.622742 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-4e065c0d-639a-4d70-8cb5-e9698a184683 req-dff33dd2-463f-43f3-ae2a-e12a8f0f1cc5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055734 Dec 14 10:11:14.624129 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 187/387] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:11:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:11:14.887727 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-cc1e3248-83e1-4548-82e2-19b678c7424c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:14.888944 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-cc1e3248-83e1-4548-82e2-19b678c7424c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:14.896906 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cc1e3248-83e1-4548-82e2-19b678c7424c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:14.897349 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cc1e3248-83e1-4548-82e2-19b678c7424c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:14.898381 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cc1e3248-83e1-4548-82e2-19b678c7424c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:14.898804 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cc1e3248-83e1-4548-82e2-19b678c7424c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:15.174005 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-9bfb1a82-c6fb-4630-bfb8-a5ed78ebe275 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:15.175858 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-9bfb1a82-c6fb-4630-bfb8-a5ed78ebe275 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:15.182321 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-cc1e3248-83e1-4548-82e2-19b678c7424c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:15.191844 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-cc1e3248-83e1-4548-82e2-19b678c7424c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1271 microversion: 2.1 time: 0.307715 Dec 14 10:11:15.193179 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 201/388] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:14 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1271 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:15.194000 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9bfb1a82-c6fb-4630-bfb8-a5ed78ebe275 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:15.196153 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9bfb1a82-c6fb-4630-bfb8-a5ed78ebe275 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:15.197045 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9bfb1a82-c6fb-4630-bfb8-a5ed78ebe275 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:15.201063 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9bfb1a82-c6fb-4630-bfb8-a5ed78ebe275 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:15.464858 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-9bfb1a82-c6fb-4630-bfb8-a5ed78ebe275 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:15.484154 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-9bfb1a82-c6fb-4630-bfb8-a5ed78ebe275 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.315224 Dec 14 10:11:15.484709 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 188/389] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:15 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:16.208493 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-eb054d1c-470d-4f35-815e-a9eaf9f620ae tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:16.209109 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-eb054d1c-470d-4f35-815e-a9eaf9f620ae tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:16.222101 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-eb054d1c-470d-4f35-815e-a9eaf9f620ae tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:16.222649 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-eb054d1c-470d-4f35-815e-a9eaf9f620ae tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:16.223444 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-eb054d1c-470d-4f35-815e-a9eaf9f620ae tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:16.223878 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-eb054d1c-470d-4f35-815e-a9eaf9f620ae tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:16.502391 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-ae688b0c-652e-4990-b595-f5548bdacf86 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:16.503503 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-ae688b0c-652e-4990-b595-f5548bdacf86 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:16.521295 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ae688b0c-652e-4990-b595-f5548bdacf86 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:16.522049 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ae688b0c-652e-4990-b595-f5548bdacf86 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:16.523021 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ae688b0c-652e-4990-b595-f5548bdacf86 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:16.523651 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ae688b0c-652e-4990-b595-f5548bdacf86 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:17.033317 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-eb054d1c-470d-4f35-815e-a9eaf9f620ae tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:17.046544 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-eb054d1c-470d-4f35-815e-a9eaf9f620ae tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1271 microversion: 2.1 time: 0.841555 Dec 14 10:11:17.047546 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 202/390] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:16 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1271 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:17.072914 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-ae688b0c-652e-4990-b595-f5548bdacf86 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:17.101699 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-ae688b0c-652e-4990-b595-f5548bdacf86 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.603830 Dec 14 10:11:17.102659 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 189/391] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:16 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:18.071437 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-977f5824-ae74-4255-b039-1426245f424b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:18.073214 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-977f5824-ae74-4255-b039-1426245f424b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:18.092428 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-977f5824-ae74-4255-b039-1426245f424b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:18.093131 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-977f5824-ae74-4255-b039-1426245f424b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:18.094141 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-977f5824-ae74-4255-b039-1426245f424b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:18.094734 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-977f5824-ae74-4255-b039-1426245f424b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:18.122097 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e339cf5b-14f3-48ea-83b1-11beb5c74176 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:18.122972 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e339cf5b-14f3-48ea-83b1-11beb5c74176 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:18.142619 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e339cf5b-14f3-48ea-83b1-11beb5c74176 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:18.143176 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e339cf5b-14f3-48ea-83b1-11beb5c74176 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:18.144141 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e339cf5b-14f3-48ea-83b1-11beb5c74176 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:18.144601 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e339cf5b-14f3-48ea-83b1-11beb5c74176 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:18.377935 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-e339cf5b-14f3-48ea-83b1-11beb5c74176 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:18.380461 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-977f5824-ae74-4255-b039-1426245f424b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:18.405063 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e339cf5b-14f3-48ea-83b1-11beb5c74176 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.286991 Dec 14 10:11:18.406139 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 190/392] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:18 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:18.422593 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-977f5824-ae74-4255-b039-1426245f424b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1271 microversion: 2.1 time: 0.332734 Dec 14 10:11:18.423616 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 203/393] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:18 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1271 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:19.426946 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-7596a2d7-c53b-42f1-9d79-2c3f8bfb9c16 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:19.427561 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-7596a2d7-c53b-42f1-9d79-2c3f8bfb9c16 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:19.438669 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-389c38b6-d4b5-4e4e-9f92-bca9e30e54bb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:19.439843 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-389c38b6-d4b5-4e4e-9f92-bca9e30e54bb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:19.440829 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7596a2d7-c53b-42f1-9d79-2c3f8bfb9c16 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:19.448618 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-389c38b6-d4b5-4e4e-9f92-bca9e30e54bb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:19.449057 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-389c38b6-d4b5-4e4e-9f92-bca9e30e54bb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:19.449187 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7596a2d7-c53b-42f1-9d79-2c3f8bfb9c16 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:19.450107 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-389c38b6-d4b5-4e4e-9f92-bca9e30e54bb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:19.450849 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7596a2d7-c53b-42f1-9d79-2c3f8bfb9c16 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:19.451290 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7596a2d7-c53b-42f1-9d79-2c3f8bfb9c16 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:19.451641 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-389c38b6-d4b5-4e4e-9f92-bca9e30e54bb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:19.708492 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-389c38b6-d4b5-4e4e-9f92-bca9e30e54bb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:19.717449 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-7596a2d7-c53b-42f1-9d79-2c3f8bfb9c16 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:19.718038 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-389c38b6-d4b5-4e4e-9f92-bca9e30e54bb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1271 microversion: 2.1 time: 0.282815 Dec 14 10:11:19.727787 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 204/394] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:19 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1271 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:19.729620 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-7596a2d7-c53b-42f1-9d79-2c3f8bfb9c16 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.306137 Dec 14 10:11:19.730552 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 191/395] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:19 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:20.182840 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-7212df73-d665-4549-9615-ca2e0834cea4 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:20.183335 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-7212df73-d665-4549-9615-ca2e0834cea4 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:20.195022 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7212df73-d665-4549-9615-ca2e0834cea4 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:20.195466 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7212df73-d665-4549-9615-ca2e0834cea4 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:20.196238 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7212df73-d665-4549-9615-ca2e0834cea4 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:20.196663 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7212df73-d665-4549-9615-ca2e0834cea4 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:20.361713 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.objects.instance [None req-7212df73-d665-4549-9615-ca2e0834cea4 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lazy-loading 'services' on Instance uuid db6ba6ce-0853-4c2d-9cdd-489058bb57df {{(pid=100984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:11:20.517364 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-7212df73-d665-4549-9615-ca2e0834cea4 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "DELETE /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df/os-volume_attachments/b6c6f9ff-165a-43b3-b1fa-ff35dec76c5a" status: 202 len: 0 microversion: 2.1 time: 0.337907 Dec 14 10:11:20.526115 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 205/396] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Dec 14 10:11:20 2021] DELETE /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df/os-volume_attachments/b6c6f9ff-165a-43b3-b1fa-ff35dec76c5a => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:11:20.735397 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c484c956-a35f-4f80-b198-cc940ecfedb2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:20.736647 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c484c956-a35f-4f80-b198-cc940ecfedb2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:20.749120 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c484c956-a35f-4f80-b198-cc940ecfedb2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:20.749780 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c484c956-a35f-4f80-b198-cc940ecfedb2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:20.750620 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c484c956-a35f-4f80-b198-cc940ecfedb2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:20.751046 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c484c956-a35f-4f80-b198-cc940ecfedb2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:20.758409 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e0bfa684-cefa-486c-addd-747ad45035af tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:20.759565 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e0bfa684-cefa-486c-addd-747ad45035af tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:20.784075 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e0bfa684-cefa-486c-addd-747ad45035af tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:20.784833 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e0bfa684-cefa-486c-addd-747ad45035af tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:20.785865 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e0bfa684-cefa-486c-addd-747ad45035af tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:20.786548 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e0bfa684-cefa-486c-addd-747ad45035af tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:20.997093 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-c484c956-a35f-4f80-b198-cc940ecfedb2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:21.006306 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c484c956-a35f-4f80-b198-cc940ecfedb2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1271 microversion: 2.1 time: 0.274987 Dec 14 10:11:21.007761 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 192/397] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:20 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1271 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:21.023940 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e0bfa684-cefa-486c-addd-747ad45035af tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:21.034418 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e0bfa684-cefa-486c-addd-747ad45035af tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.290308 Dec 14 10:11:21.035331 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 206/398] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:20 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:21.551131 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6ccf3dc1-b41a-4d3c-a318-4616c1b44e66 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Action: 'create', calling method: .version_select at 0x7fb17a5df9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1209786059"}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:21.572896 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-6ccf3dc1-b41a-4d3c-a318-4616c1b44e66 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Getting quotas for project 2fb4616940ba4338a7eaf7b0a17e974a. Resources: {'key_pairs'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:11:21.576784 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-6ccf3dc1-b41a-4d3c-a318-4616c1b44e66 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Getting quotas for user 4d5aa925da1c459aac12363343f6d7a0 and project 2fb4616940ba4338a7eaf7b0a17e974a. Resources: {'key_pairs'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:11:21.847948 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-6ccf3dc1-b41a-4d3c-a318-4616c1b44e66 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Getting quotas for project 2fb4616940ba4338a7eaf7b0a17e974a. Resources: {'key_pairs'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:11:21.851646 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-6ccf3dc1-b41a-4d3c-a318-4616c1b44e66 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Getting quotas for user 4d5aa925da1c459aac12363343f6d7a0 and project 2fb4616940ba4338a7eaf7b0a17e974a. Resources: {'key_pairs'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:11:21.867673 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6ccf3dc1-b41a-4d3c-a318-4616c1b44e66 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.323561 Dec 14 10:11:21.868254 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 193/399] 10.222.0.20 () {60 vars in 1157 bytes} [Tue Dec 14 10:11:21 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:21.918440 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f3e49170-a08a-4601-982c-2567f2c94966 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-808481302", "imageRef": "89d895f4-6ee0-4a4d-b19f-d79c4ef76a0e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1209786059", "networks": [{"uuid": "c7da5988-e255-44e6-981a-3c49fb3fb3ad"}]}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:21.983734 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.network.neutron [None req-f3e49170-a08a-4601-982c-2567f2c94966 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] validate_networks() for [('c7da5988-e255-44e6-981a-3c49fb3fb3ad', None, None, None)] {{(pid=100984) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:11:22.024108 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-71db68ca-eea9-4ed4-8c95-ea37be46f45c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:22.024628 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-71db68ca-eea9-4ed4-8c95-ea37be46f45c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:22.032838 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-71db68ca-eea9-4ed4-8c95-ea37be46f45c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:22.033277 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-71db68ca-eea9-4ed4-8c95-ea37be46f45c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:22.034060 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-71db68ca-eea9-4ed4-8c95-ea37be46f45c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:22.034489 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-71db68ca-eea9-4ed4-8c95-ea37be46f45c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:22.236995 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-71db68ca-eea9-4ed4-8c95-ea37be46f45c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:22.245321 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-71db68ca-eea9-4ed4-8c95-ea37be46f45c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1271 microversion: 2.1 time: 0.225057 Dec 14 10:11:22.245883 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 194/400] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:22 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1271 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:22.250675 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-d1c69664-2f00-4234-8535-a517f5e0838e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:22.251289 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-d1c69664-2f00-4234-8535-a517f5e0838e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:22.258513 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d1c69664-2f00-4234-8535-a517f5e0838e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:22.258966 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d1c69664-2f00-4234-8535-a517f5e0838e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:22.259740 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d1c69664-2f00-4234-8535-a517f5e0838e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:22.260320 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d1c69664-2f00-4234-8535-a517f5e0838e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:22.460780 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-d1c69664-2f00-4234-8535-a517f5e0838e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:22.469548 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-d1c69664-2f00-4234-8535-a517f5e0838e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.222565 Dec 14 10:11:22.470141 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 195/401] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:22 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:22.545171 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-f3e49170-a08a-4601-982c-2567f2c94966 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Flavor limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:11:22.545588 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-f3e49170-a08a-4601-982c-2567f2c94966 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Image limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:11:22.546083 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-f3e49170-a08a-4601-982c-2567f2c94966 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Flavor pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:11:22.546493 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-f3e49170-a08a-4601-982c-2567f2c94966 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Image pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:11:22.546927 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-f3e49170-a08a-4601-982c-2567f2c94966 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:11:22.555154 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f3e49170-a08a-4601-982c-2567f2c94966 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:22.555596 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f3e49170-a08a-4601-982c-2567f2c94966 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:22.556384 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f3e49170-a08a-4601-982c-2567f2c94966 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:22.556818 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f3e49170-a08a-4601-982c-2567f2c94966 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:22.573673 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-f3e49170-a08a-4601-982c-2567f2c94966 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Getting quotas for project 2fb4616940ba4338a7eaf7b0a17e974a. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:11:22.577833 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-f3e49170-a08a-4601-982c-2567f2c94966 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Getting quotas for user 4d5aa925da1c459aac12363343f6d7a0 and project 2fb4616940ba4338a7eaf7b0a17e974a. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:11:22.588066 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f3e49170-a08a-4601-982c-2567f2c94966 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Going to run 1 instances... {{(pid=100984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:11:22.590293 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f3e49170-a08a-4601-982c-2567f2c94966 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89d895f4-6ee0-4a4d-b19f-d79c4ef76a0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:11:22.635030 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f3e49170-a08a-4601-982c-2567f2c94966 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720141 Dec 14 10:11:22.635630 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 207/402] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Dec 14 10:11:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 10:11:22.645492 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-99314f86-701c-4a7e-be3e-837c9bb21bd4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:22.646225 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-99314f86-701c-4a7e-be3e-837c9bb21bd4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:22.741015 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-99314f86-701c-4a7e-be3e-837c9bb21bd4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:22.749454 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-99314f86-701c-4a7e-be3e-837c9bb21bd4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1258 microversion: 2.1 time: 0.107337 Dec 14 10:11:22.750607 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 196/403] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:22 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1258 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:23.261928 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-b4f2d227-6a9a-47b7-ba49-31e9101bbea6 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:23.262574 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-b4f2d227-6a9a-47b7-ba49-31e9101bbea6 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:23.269741 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b4f2d227-6a9a-47b7-ba49-31e9101bbea6 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:23.270216 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b4f2d227-6a9a-47b7-ba49-31e9101bbea6 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:23.270980 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b4f2d227-6a9a-47b7-ba49-31e9101bbea6 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:23.271401 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b4f2d227-6a9a-47b7-ba49-31e9101bbea6 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:23.470256 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-b4f2d227-6a9a-47b7-ba49-31e9101bbea6 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:23.478230 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-b4f2d227-6a9a-47b7-ba49-31e9101bbea6 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1271 microversion: 2.1 time: 0.220021 Dec 14 10:11:23.478787 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 208/404] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:23 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1271 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:23.487911 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e2cd6f5c-84db-40e1-9852-1630d97d8506 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:23.488758 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e2cd6f5c-84db-40e1-9852-1630d97d8506 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:23.497315 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e2cd6f5c-84db-40e1-9852-1630d97d8506 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:23.498139 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e2cd6f5c-84db-40e1-9852-1630d97d8506 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:23.498919 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e2cd6f5c-84db-40e1-9852-1630d97d8506 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:23.499354 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e2cd6f5c-84db-40e1-9852-1630d97d8506 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:23.702096 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-e2cd6f5c-84db-40e1-9852-1630d97d8506 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:23.711940 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e2cd6f5c-84db-40e1-9852-1630d97d8506 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.228546 Dec 14 10:11:23.712805 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 197/405] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:23 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:23.767129 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d9676211-c5d1-4e36-ade0-6414b88b17ab tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:23.767623 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d9676211-c5d1-4e36-ade0-6414b88b17ab tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:23.775051 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d9676211-c5d1-4e36-ade0-6414b88b17ab tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:23.775510 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d9676211-c5d1-4e36-ade0-6414b88b17ab tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:23.776268 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d9676211-c5d1-4e36-ade0-6414b88b17ab tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:23.776697 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d9676211-c5d1-4e36-ade0-6414b88b17ab tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:23.813571 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-8d4a3e34-60db-4bc6-8720-647e3661f93b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:23.815077 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-8d4a3e34-60db-4bc6-8720-647e3661f93b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:23.822982 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8d4a3e34-60db-4bc6-8720-647e3661f93b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:23.823441 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8d4a3e34-60db-4bc6-8720-647e3661f93b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:23.824222 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8d4a3e34-60db-4bc6-8720-647e3661f93b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:23.824656 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8d4a3e34-60db-4bc6-8720-647e3661f93b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:23.921214 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.objects.instance [None req-8d4a3e34-60db-4bc6-8720-647e3661f93b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lazy-loading 'flavor' on Instance uuid 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd {{(pid=100985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:11:23.964904 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d9676211-c5d1-4e36-ade0-6414b88b17ab tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:23.974797 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d9676211-c5d1-4e36-ade0-6414b88b17ab tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1318 microversion: 2.1 time: 0.211859 Dec 14 10:11:23.975517 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 209/406] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:23 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:24.243578 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-8d4a3e34-60db-4bc6-8720-647e3661f93b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "POST /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/action" status: 200 len: 32 microversion: 2.1 time: 0.435023 Dec 14 10:11:24.248974 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 198/407] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:11:23 2021] POST /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/action => generated 32 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 14 10:11:24.254166 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a7286804-b97a-42ba-9da4-6c9644db421d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:24.255006 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-a7286804-b97a-42ba-9da4-6c9644db421d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:24.264287 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a7286804-b97a-42ba-9da4-6c9644db421d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:24.266261 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a7286804-b97a-42ba-9da4-6c9644db421d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:24.267930 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a7286804-b97a-42ba-9da4-6c9644db421d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:24.268672 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a7286804-b97a-42ba-9da4-6c9644db421d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:24.496081 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a8cda1b1-f7bf-4add-94ce-3dac92c61cf2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:24.496973 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a8cda1b1-f7bf-4add-94ce-3dac92c61cf2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:24.505676 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a8cda1b1-f7bf-4add-94ce-3dac92c61cf2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:24.506533 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a8cda1b1-f7bf-4add-94ce-3dac92c61cf2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:24.507401 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a8cda1b1-f7bf-4add-94ce-3dac92c61cf2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:24.507913 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a8cda1b1-f7bf-4add-94ce-3dac92c61cf2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:24.681169 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-a7286804-b97a-42ba-9da4-6c9644db421d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:24.693921 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a7286804-b97a-42ba-9da4-6c9644db421d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.443773 Dec 14 10:11:24.696832 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 210/408] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:24 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:24.730322 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-53e44a71-acd2-44ff-b6b1-ceb0c2493f29 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:24.731271 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-53e44a71-acd2-44ff-b6b1-ceb0c2493f29 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:24.748409 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-53e44a71-acd2-44ff-b6b1-ceb0c2493f29 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:24.749267 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-53e44a71-acd2-44ff-b6b1-ceb0c2493f29 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:24.750270 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-53e44a71-acd2-44ff-b6b1-ceb0c2493f29 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:24.750857 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-53e44a71-acd2-44ff-b6b1-ceb0c2493f29 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:25.062050 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-a8cda1b1-f7bf-4add-94ce-3dac92c61cf2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:25.083256 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a8cda1b1-f7bf-4add-94ce-3dac92c61cf2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1271 microversion: 2.1 time: 0.585493 Dec 14 10:11:25.092161 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 199/409] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:24 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1271 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:25.112805 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-97ba8732-48ff-433f-9ac9-aacf59b8ed1e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:25.116139 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-97ba8732-48ff-433f-9ac9-aacf59b8ed1e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:25.150927 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-97ba8732-48ff-433f-9ac9-aacf59b8ed1e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:25.151632 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-97ba8732-48ff-433f-9ac9-aacf59b8ed1e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:25.160247 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-97ba8732-48ff-433f-9ac9-aacf59b8ed1e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:25.160695 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-97ba8732-48ff-433f-9ac9-aacf59b8ed1e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:25.479059 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-53e44a71-acd2-44ff-b6b1-ceb0c2493f29 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:25.494927 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-53e44a71-acd2-44ff-b6b1-ceb0c2493f29 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.764716 Dec 14 10:11:25.495815 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 211/410] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:24 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:25.609591 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-97ba8732-48ff-433f-9ac9-aacf59b8ed1e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:25.618568 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-97ba8732-48ff-433f-9ac9-aacf59b8ed1e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1358 microversion: 2.1 time: 0.524416 Dec 14 10:11:25.619123 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 200/411] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:25 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1358 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:25.713479 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-208fc162-1a3e-4693-a845-3d90a85805d1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:25.714202 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-208fc162-1a3e-4693-a845-3d90a85805d1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:25.722509 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-208fc162-1a3e-4693-a845-3d90a85805d1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:25.723034 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-208fc162-1a3e-4693-a845-3d90a85805d1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:25.724040 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-208fc162-1a3e-4693-a845-3d90a85805d1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:25.724549 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-208fc162-1a3e-4693-a845-3d90a85805d1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:25.956075 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-208fc162-1a3e-4693-a845-3d90a85805d1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:25.964653 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-208fc162-1a3e-4693-a845-3d90a85805d1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.254799 Dec 14 10:11:25.965206 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 212/412] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:25 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:26.101793 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f93cd912-5d14-4797-833d-f93aaf8dde01 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:26.103098 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f93cd912-5d14-4797-833d-f93aaf8dde01 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:26.112182 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f93cd912-5d14-4797-833d-f93aaf8dde01 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:26.113338 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f93cd912-5d14-4797-833d-f93aaf8dde01 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:26.114211 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f93cd912-5d14-4797-833d-f93aaf8dde01 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:26.114730 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f93cd912-5d14-4797-833d-f93aaf8dde01 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:26.353694 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f93cd912-5d14-4797-833d-f93aaf8dde01 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:26.363851 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f93cd912-5d14-4797-833d-f93aaf8dde01 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1271 microversion: 2.1 time: 0.265660 Dec 14 10:11:26.382274 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 201/413] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:26 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1271 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:26.515646 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4909b108-87e7-4597-a6ec-4d94a3f0dee0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:26.517740 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4909b108-87e7-4597-a6ec-4d94a3f0dee0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:26.529532 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4909b108-87e7-4597-a6ec-4d94a3f0dee0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:26.530225 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4909b108-87e7-4597-a6ec-4d94a3f0dee0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:26.531165 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4909b108-87e7-4597-a6ec-4d94a3f0dee0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:26.531741 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4909b108-87e7-4597-a6ec-4d94a3f0dee0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:26.638050 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-2974459e-01c8-4eea-a458-fc0b2bfa538e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:26.639077 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-2974459e-01c8-4eea-a458-fc0b2bfa538e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:26.657407 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2974459e-01c8-4eea-a458-fc0b2bfa538e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:26.657967 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2974459e-01c8-4eea-a458-fc0b2bfa538e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:26.658857 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2974459e-01c8-4eea-a458-fc0b2bfa538e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:26.659360 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2974459e-01c8-4eea-a458-fc0b2bfa538e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:26.787785 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4909b108-87e7-4597-a6ec-4d94a3f0dee0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:26.797158 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4909b108-87e7-4597-a6ec-4d94a3f0dee0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.286008 Dec 14 10:11:26.797751 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 213/414] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:26 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:26.886881 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-2974459e-01c8-4eea-a458-fc0b2bfa538e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:26.895932 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-2974459e-01c8-4eea-a458-fc0b2bfa538e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1358 microversion: 2.1 time: 0.263030 Dec 14 10:11:26.896501 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 202/415] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:26 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1358 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:26.982394 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-49efb5ab-d0c1-4b4d-ba50-967ed1d6828b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:26.982995 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-49efb5ab-d0c1-4b4d-ba50-967ed1d6828b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:26.990530 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49efb5ab-d0c1-4b4d-ba50-967ed1d6828b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:26.990969 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49efb5ab-d0c1-4b4d-ba50-967ed1d6828b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:26.991730 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49efb5ab-d0c1-4b4d-ba50-967ed1d6828b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:26.992154 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49efb5ab-d0c1-4b4d-ba50-967ed1d6828b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:27.205706 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-49efb5ab-d0c1-4b4d-ba50-967ed1d6828b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:27.216555 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-49efb5ab-d0c1-4b4d-ba50-967ed1d6828b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.237719 Dec 14 10:11:27.218122 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 214/416] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:26 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:27.382000 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f07984e7-4c53-4388-b392-4ab777e0c9ff tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:27.382611 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f07984e7-4c53-4388-b392-4ab777e0c9ff tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:27.390266 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f07984e7-4c53-4388-b392-4ab777e0c9ff tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:27.390708 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f07984e7-4c53-4388-b392-4ab777e0c9ff tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:27.391472 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f07984e7-4c53-4388-b392-4ab777e0c9ff tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:27.391886 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f07984e7-4c53-4388-b392-4ab777e0c9ff tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:27.618472 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f07984e7-4c53-4388-b392-4ab777e0c9ff tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:27.630194 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f07984e7-4c53-4388-b392-4ab777e0c9ff tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1271 microversion: 2.1 time: 0.251698 Dec 14 10:11:27.630798 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 203/417] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:27 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:27.815336 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-26b308ca-9fcc-4a91-86dd-913e8a12fc52 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:27.815943 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-26b308ca-9fcc-4a91-86dd-913e8a12fc52 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:27.824223 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-26b308ca-9fcc-4a91-86dd-913e8a12fc52 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:27.824223 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-26b308ca-9fcc-4a91-86dd-913e8a12fc52 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:27.824794 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-26b308ca-9fcc-4a91-86dd-913e8a12fc52 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:27.826523 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-26b308ca-9fcc-4a91-86dd-913e8a12fc52 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:27.915709 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3603fa7a-6920-40b1-90d5-a0c4d82063f5 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:27.917629 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3603fa7a-6920-40b1-90d5-a0c4d82063f5 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:27.929083 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3603fa7a-6920-40b1-90d5-a0c4d82063f5 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:27.929912 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3603fa7a-6920-40b1-90d5-a0c4d82063f5 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:27.931052 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3603fa7a-6920-40b1-90d5-a0c4d82063f5 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:27.931742 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3603fa7a-6920-40b1-90d5-a0c4d82063f5 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:28.120127 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-26b308ca-9fcc-4a91-86dd-913e8a12fc52 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:28.139187 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-26b308ca-9fcc-4a91-86dd-913e8a12fc52 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.327748 Dec 14 10:11:28.139889 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 215/418] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:27 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:28.236083 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-7adb0e4b-e8c4-4919-b2d3-76d1d7dfa5e9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:28.236981 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-7adb0e4b-e8c4-4919-b2d3-76d1d7dfa5e9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:28.244994 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3603fa7a-6920-40b1-90d5-a0c4d82063f5 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:28.249904 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7adb0e4b-e8c4-4919-b2d3-76d1d7dfa5e9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:28.251269 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7adb0e4b-e8c4-4919-b2d3-76d1d7dfa5e9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:28.252498 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7adb0e4b-e8c4-4919-b2d3-76d1d7dfa5e9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:28.253137 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7adb0e4b-e8c4-4919-b2d3-76d1d7dfa5e9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:28.269054 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3603fa7a-6920-40b1-90d5-a0c4d82063f5 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1358 microversion: 2.1 time: 0.358965 Dec 14 10:11:28.273082 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 204/419] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:27 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1358 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:28.514989 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-7adb0e4b-e8c4-4919-b2d3-76d1d7dfa5e9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:28.524471 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-7adb0e4b-e8c4-4919-b2d3-76d1d7dfa5e9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.293476 Dec 14 10:11:28.525401 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 216/420] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:28 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:28.647773 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-073966e3-5ec2-47af-a8e8-aab981d69d02 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:28.648380 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-073966e3-5ec2-47af-a8e8-aab981d69d02 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:28.656406 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-073966e3-5ec2-47af-a8e8-aab981d69d02 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:28.656792 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-073966e3-5ec2-47af-a8e8-aab981d69d02 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:28.657569 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-073966e3-5ec2-47af-a8e8-aab981d69d02 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:28.658015 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-073966e3-5ec2-47af-a8e8-aab981d69d02 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:28.877602 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-073966e3-5ec2-47af-a8e8-aab981d69d02 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:28.886025 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-073966e3-5ec2-47af-a8e8-aab981d69d02 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1271 microversion: 2.1 time: 0.241822 Dec 14 10:11:28.886867 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 205/421] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:28 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1271 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:29.159134 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8ffb2ffc-8eba-4a04-a72d-e4bd8bf10380 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:29.160386 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-8ffb2ffc-8eba-4a04-a72d-e4bd8bf10380 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:29.167958 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8ffb2ffc-8eba-4a04-a72d-e4bd8bf10380 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:29.168397 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8ffb2ffc-8eba-4a04-a72d-e4bd8bf10380 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:29.170230 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8ffb2ffc-8eba-4a04-a72d-e4bd8bf10380 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:29.171034 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8ffb2ffc-8eba-4a04-a72d-e4bd8bf10380 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:29.289079 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-39cee8e0-a10c-4877-aabf-33bf9840b518 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:29.290624 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-39cee8e0-a10c-4877-aabf-33bf9840b518 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:29.298896 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-39cee8e0-a10c-4877-aabf-33bf9840b518 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:29.299618 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-39cee8e0-a10c-4877-aabf-33bf9840b518 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:29.300389 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-39cee8e0-a10c-4877-aabf-33bf9840b518 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:29.300975 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-39cee8e0-a10c-4877-aabf-33bf9840b518 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:29.379069 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-8ffb2ffc-8eba-4a04-a72d-e4bd8bf10380 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:29.389116 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8ffb2ffc-8eba-4a04-a72d-e4bd8bf10380 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.233301 Dec 14 10:11:29.389905 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 217/422] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:29 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:29.542735 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-cf1c8578-dc28-40d9-989a-6d79c780a901 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:29.543814 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-cf1c8578-dc28-40d9-989a-6d79c780a901 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:29.552519 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cf1c8578-dc28-40d9-989a-6d79c780a901 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:29.552944 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cf1c8578-dc28-40d9-989a-6d79c780a901 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:29.553745 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cf1c8578-dc28-40d9-989a-6d79c780a901 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:29.554169 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cf1c8578-dc28-40d9-989a-6d79c780a901 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:29.562296 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-39cee8e0-a10c-4877-aabf-33bf9840b518 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:29.571050 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-39cee8e0-a10c-4877-aabf-33bf9840b518 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1358 microversion: 2.1 time: 0.285804 Dec 14 10:11:29.573258 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 206/423] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:29 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1358 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:29.787567 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-cf1c8578-dc28-40d9-989a-6d79c780a901 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:29.798166 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-cf1c8578-dc28-40d9-989a-6d79c780a901 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.259105 Dec 14 10:11:29.798737 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 218/424] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:29 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:29.906040 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-9431b044-34cf-4143-be83-2aa7b57ac5ab tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:29.906686 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-9431b044-34cf-4143-be83-2aa7b57ac5ab tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:29.914657 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9431b044-34cf-4143-be83-2aa7b57ac5ab tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:29.915103 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9431b044-34cf-4143-be83-2aa7b57ac5ab tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:29.915880 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9431b044-34cf-4143-be83-2aa7b57ac5ab tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:29.916311 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9431b044-34cf-4143-be83-2aa7b57ac5ab tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:30.116285 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-9431b044-34cf-4143-be83-2aa7b57ac5ab tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:30.125820 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-9431b044-34cf-4143-be83-2aa7b57ac5ab tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1271 microversion: 2.1 time: 0.225777 Dec 14 10:11:30.126597 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 207/425] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:29 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1271 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:30.408815 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d919a92f-64a6-4268-8b28-4b55c878c820 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:30.409453 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d919a92f-64a6-4268-8b28-4b55c878c820 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:30.420495 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d919a92f-64a6-4268-8b28-4b55c878c820 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:30.420943 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d919a92f-64a6-4268-8b28-4b55c878c820 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:30.421708 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d919a92f-64a6-4268-8b28-4b55c878c820 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:30.422335 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d919a92f-64a6-4268-8b28-4b55c878c820 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:30.587954 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-67babd23-c873-47d1-8fdc-48cb76a65088 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:30.588569 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-67babd23-c873-47d1-8fdc-48cb76a65088 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:30.596624 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-67babd23-c873-47d1-8fdc-48cb76a65088 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:30.597214 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-67babd23-c873-47d1-8fdc-48cb76a65088 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:30.598011 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-67babd23-c873-47d1-8fdc-48cb76a65088 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:30.598448 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-67babd23-c873-47d1-8fdc-48cb76a65088 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:30.672019 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d919a92f-64a6-4268-8b28-4b55c878c820 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:30.689917 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d919a92f-64a6-4268-8b28-4b55c878c820 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.279052 Dec 14 10:11:30.692918 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 219/426] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:30 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:30.816183 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-dde95d49-1042-4a52-969c-bdda70edf6f3 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:30.816819 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-dde95d49-1042-4a52-969c-bdda70edf6f3 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:30.839662 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dde95d49-1042-4a52-969c-bdda70edf6f3 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:30.840114 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dde95d49-1042-4a52-969c-bdda70edf6f3 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:30.840980 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dde95d49-1042-4a52-969c-bdda70edf6f3 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:30.841571 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dde95d49-1042-4a52-969c-bdda70edf6f3 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:31.005838 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-67babd23-c873-47d1-8fdc-48cb76a65088 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:31.015395 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-67babd23-c873-47d1-8fdc-48cb76a65088 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1358 microversion: 2.1 time: 0.431203 Dec 14 10:11:31.025379 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 208/427] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:30 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1358 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:31.121398 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-dde95d49-1042-4a52-969c-bdda70edf6f3 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:31.135769 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-dde95d49-1042-4a52-969c-bdda70edf6f3 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.322942 Dec 14 10:11:31.136355 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 220/428] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:30 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:31.144085 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3618432c-1743-44a9-889d-7d55b8a6edab tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:31.144981 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3618432c-1743-44a9-889d-7d55b8a6edab tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:31.154575 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3618432c-1743-44a9-889d-7d55b8a6edab tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:31.155311 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3618432c-1743-44a9-889d-7d55b8a6edab tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:31.156310 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3618432c-1743-44a9-889d-7d55b8a6edab tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:31.156898 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3618432c-1743-44a9-889d-7d55b8a6edab tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:31.425064 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3618432c-1743-44a9-889d-7d55b8a6edab tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:31.434774 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3618432c-1743-44a9-889d-7d55b8a6edab tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1271 microversion: 2.1 time: 0.294466 Dec 14 10:11:31.435756 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 209/429] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:31 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1271 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:31.717062 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-afb660b3-744c-4337-9580-22ee481b98b4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:31.723261 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-afb660b3-744c-4337-9580-22ee481b98b4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:31.732434 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-afb660b3-744c-4337-9580-22ee481b98b4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:31.732897 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-afb660b3-744c-4337-9580-22ee481b98b4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:31.733895 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-afb660b3-744c-4337-9580-22ee481b98b4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:31.734560 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-afb660b3-744c-4337-9580-22ee481b98b4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:31.980975 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-afb660b3-744c-4337-9580-22ee481b98b4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:31.996054 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-afb660b3-744c-4337-9580-22ee481b98b4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.288736 Dec 14 10:11:32.007065 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 221/430] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:31 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:32.032665 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b7cfd950-5c22-492d-9afb-e2e70aa84a4a tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:32.033616 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-b7cfd950-5c22-492d-9afb-e2e70aa84a4a tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:32.044776 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b7cfd950-5c22-492d-9afb-e2e70aa84a4a tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:32.047417 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b7cfd950-5c22-492d-9afb-e2e70aa84a4a tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:32.048230 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b7cfd950-5c22-492d-9afb-e2e70aa84a4a tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:32.048669 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b7cfd950-5c22-492d-9afb-e2e70aa84a4a tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:32.153821 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-ba441df1-c489-4164-afcf-eff0114c298f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:32.154573 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-ba441df1-c489-4164-afcf-eff0114c298f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:32.168847 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ba441df1-c489-4164-afcf-eff0114c298f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:32.169222 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ba441df1-c489-4164-afcf-eff0114c298f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:32.170165 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ba441df1-c489-4164-afcf-eff0114c298f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:32.170602 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ba441df1-c489-4164-afcf-eff0114c298f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:32.329130 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-b7cfd950-5c22-492d-9afb-e2e70aa84a4a tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:32.337932 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-b7cfd950-5c22-492d-9afb-e2e70aa84a4a tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1358 microversion: 2.1 time: 0.308805 Dec 14 10:11:32.339122 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 210/431] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:32 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:32.447414 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-ba441df1-c489-4164-afcf-eff0114c298f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:32.452537 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-1db145dc-37fe-4c9a-b0d0-7afa68ebfd66 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:32.453154 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-1db145dc-37fe-4c9a-b0d0-7afa68ebfd66 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:32.461165 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1db145dc-37fe-4c9a-b0d0-7afa68ebfd66 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:32.461769 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1db145dc-37fe-4c9a-b0d0-7afa68ebfd66 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:32.462584 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1db145dc-37fe-4c9a-b0d0-7afa68ebfd66 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:32.463011 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1db145dc-37fe-4c9a-b0d0-7afa68ebfd66 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:32.465067 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-ba441df1-c489-4164-afcf-eff0114c298f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.315814 Dec 14 10:11:32.465980 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 222/432] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:32 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:32.809298 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-1db145dc-37fe-4c9a-b0d0-7afa68ebfd66 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:32.819402 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-1db145dc-37fe-4c9a-b0d0-7afa68ebfd66 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1271 microversion: 2.1 time: 0.371417 Dec 14 10:11:32.831289 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 211/433] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:32 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1271 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:33.014112 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-86ab6af9-b7fc-4fb5-b86e-befae4b58590 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:33.014855 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-86ab6af9-b7fc-4fb5-b86e-befae4b58590 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:33.030646 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-86ab6af9-b7fc-4fb5-b86e-befae4b58590 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:33.031105 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-86ab6af9-b7fc-4fb5-b86e-befae4b58590 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:33.031906 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-86ab6af9-b7fc-4fb5-b86e-befae4b58590 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:33.032323 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-86ab6af9-b7fc-4fb5-b86e-befae4b58590 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:33.272456 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-86ab6af9-b7fc-4fb5-b86e-befae4b58590 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:33.281812 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-86ab6af9-b7fc-4fb5-b86e-befae4b58590 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.272084 Dec 14 10:11:33.283222 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 223/434] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:33 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:33.355158 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-9bfcc6f9-95d3-41b7-af69-d886f4e5bcf8 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:33.355815 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-9bfcc6f9-95d3-41b7-af69-d886f4e5bcf8 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:33.363170 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9bfcc6f9-95d3-41b7-af69-d886f4e5bcf8 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:33.363609 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9bfcc6f9-95d3-41b7-af69-d886f4e5bcf8 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:33.364358 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9bfcc6f9-95d3-41b7-af69-d886f4e5bcf8 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:33.364789 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9bfcc6f9-95d3-41b7-af69-d886f4e5bcf8 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:33.483443 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-65aa7896-24d8-4fb5-ab85-3dfbb1cf7d66 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:33.484071 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-65aa7896-24d8-4fb5-ab85-3dfbb1cf7d66 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:33.491203 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-65aa7896-24d8-4fb5-ab85-3dfbb1cf7d66 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:33.491647 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-65aa7896-24d8-4fb5-ab85-3dfbb1cf7d66 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:33.492465 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-65aa7896-24d8-4fb5-ab85-3dfbb1cf7d66 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:33.492931 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-65aa7896-24d8-4fb5-ab85-3dfbb1cf7d66 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:33.582580 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-9bfcc6f9-95d3-41b7-af69-d886f4e5bcf8 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:33.591605 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-9bfcc6f9-95d3-41b7-af69-d886f4e5bcf8 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1358 microversion: 2.1 time: 0.239414 Dec 14 10:11:33.592168 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 212/435] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:33 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:33.715352 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-65aa7896-24d8-4fb5-ab85-3dfbb1cf7d66 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:33.724591 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-65aa7896-24d8-4fb5-ab85-3dfbb1cf7d66 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.245344 Dec 14 10:11:33.725486 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 224/436] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:33 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:33.837810 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-78823503-7c74-4229-ac87-9122743f9750 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:33.838375 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-78823503-7c74-4229-ac87-9122743f9750 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:33.847243 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-78823503-7c74-4229-ac87-9122743f9750 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:33.847701 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-78823503-7c74-4229-ac87-9122743f9750 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:33.848483 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-78823503-7c74-4229-ac87-9122743f9750 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:33.848918 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-78823503-7c74-4229-ac87-9122743f9750 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:34.026341 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-173ce88d-400f-425e-beef-b2fda036e5c7 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-327413176", "imageRef": "5be36fdc-2baa-4efd-b830-5a5c3fd7beba", "flavorRef": "452"}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:34.107142 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-78823503-7c74-4229-ac87-9122743f9750 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:34.112404 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.network.neutron [None req-173ce88d-400f-425e-beef-b2fda036e5c7 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] validate_networks() for None {{(pid=100984) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:11:34.116033 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-78823503-7c74-4229-ac87-9122743f9750 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1271 microversion: 2.1 time: 0.282060 Dec 14 10:11:34.116740 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 213/437] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:33 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1271 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:34.299073 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-210510e9-0ad2-4b74-99d9-8e3730b0a9ab tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:34.299722 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-210510e9-0ad2-4b74-99d9-8e3730b0a9ab tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:34.307010 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-210510e9-0ad2-4b74-99d9-8e3730b0a9ab tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:34.307533 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-210510e9-0ad2-4b74-99d9-8e3730b0a9ab tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:34.308267 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-210510e9-0ad2-4b74-99d9-8e3730b0a9ab tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:34.308705 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-210510e9-0ad2-4b74-99d9-8e3730b0a9ab tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:34.417670 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-173ce88d-400f-425e-beef-b2fda036e5c7 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Flavor limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:11:34.418127 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-173ce88d-400f-425e-beef-b2fda036e5c7 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Image limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:11:34.419440 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-173ce88d-400f-425e-beef-b2fda036e5c7 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Flavor pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:11:34.419886 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-173ce88d-400f-425e-beef-b2fda036e5c7 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Image pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:11:34.420287 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-173ce88d-400f-425e-beef-b2fda036e5c7 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:11:34.428500 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-173ce88d-400f-425e-beef-b2fda036e5c7 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:34.428948 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-173ce88d-400f-425e-beef-b2fda036e5c7 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:34.429865 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-173ce88d-400f-425e-beef-b2fda036e5c7 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:34.430341 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-173ce88d-400f-425e-beef-b2fda036e5c7 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:34.447923 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-173ce88d-400f-425e-beef-b2fda036e5c7 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Getting quotas for project 90ddd272dc894d7bb0e1b6c0b6b7275d. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:11:34.451683 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-173ce88d-400f-425e-beef-b2fda036e5c7 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Getting quotas for user 2232ae85e2374690b7d4671b680be456 and project 90ddd272dc894d7bb0e1b6c0b6b7275d. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:11:34.462556 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-173ce88d-400f-425e-beef-b2fda036e5c7 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Going to run 1 instances... {{(pid=100984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:11:34.464818 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-173ce88d-400f-425e-beef-b2fda036e5c7 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5be36fdc-2baa-4efd-b830-5a5c3fd7beba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:11:34.511621 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-173ce88d-400f-425e-beef-b2fda036e5c7 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.489104 Dec 14 10:11:34.513484 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 225/438] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Dec 14 10:11:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 14 10:11:34.527518 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a15bfaec-c273-45b5-b3e7-1069590b5414 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:34.530722 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-a15bfaec-c273-45b5-b3e7-1069590b5414 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:34.550228 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-210510e9-0ad2-4b74-99d9-8e3730b0a9ab tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:34.559922 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-210510e9-0ad2-4b74-99d9-8e3730b0a9ab tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.264520 Dec 14 10:11:34.566855 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 214/439] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:34 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:34.609883 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b3785e32-ff41-4186-b13e-be6e3c8abbff tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:34.610555 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-b3785e32-ff41-4186-b13e-be6e3c8abbff tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:34.616004 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-a15bfaec-c273-45b5-b3e7-1069590b5414 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:34.623284 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b3785e32-ff41-4186-b13e-be6e3c8abbff tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:34.627202 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b3785e32-ff41-4186-b13e-be6e3c8abbff tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:34.628076 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b3785e32-ff41-4186-b13e-be6e3c8abbff tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:34.628521 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b3785e32-ff41-4186-b13e-be6e3c8abbff tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:34.629531 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a15bfaec-c273-45b5-b3e7-1069590b5414 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1214 microversion: 2.1 time: 0.108531 Dec 14 10:11:34.630551 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 226/440] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:34 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:34.744735 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-838b066b-cf01-4f62-a380-36f97e7628f9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:34.745398 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-838b066b-cf01-4f62-a380-36f97e7628f9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:34.768569 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-838b066b-cf01-4f62-a380-36f97e7628f9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:34.769299 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-838b066b-cf01-4f62-a380-36f97e7628f9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:34.770304 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-838b066b-cf01-4f62-a380-36f97e7628f9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:34.770938 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-838b066b-cf01-4f62-a380-36f97e7628f9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:34.849596 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-b3785e32-ff41-4186-b13e-be6e3c8abbff tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:34.860751 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-b3785e32-ff41-4186-b13e-be6e3c8abbff tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1358 microversion: 2.1 time: 0.256588 Dec 14 10:11:34.861800 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 215/441] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:34 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:35.035661 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-838b066b-cf01-4f62-a380-36f97e7628f9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:35.051203 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-838b066b-cf01-4f62-a380-36f97e7628f9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.311383 Dec 14 10:11:35.052322 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 227/442] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:34 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:35.133130 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-7e0ea638-2592-4008-8131-cf090f99344b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:35.134184 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-7e0ea638-2592-4008-8131-cf090f99344b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:35.142814 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7e0ea638-2592-4008-8131-cf090f99344b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:35.143539 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7e0ea638-2592-4008-8131-cf090f99344b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:35.144695 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7e0ea638-2592-4008-8131-cf090f99344b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:35.145278 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7e0ea638-2592-4008-8131-cf090f99344b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:35.358805 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-7e0ea638-2592-4008-8131-cf090f99344b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:35.366836 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-7e0ea638-2592-4008-8131-cf090f99344b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1271 microversion: 2.1 time: 0.237497 Dec 14 10:11:35.367396 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 216/443] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:35 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1271 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:35.578610 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5d582a0a-db61-446d-bdfc-b0d1986520cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:35.579215 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5d582a0a-db61-446d-bdfc-b0d1986520cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:35.587336 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5d582a0a-db61-446d-bdfc-b0d1986520cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:35.587901 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5d582a0a-db61-446d-bdfc-b0d1986520cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:35.588714 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5d582a0a-db61-446d-bdfc-b0d1986520cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:35.589146 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5d582a0a-db61-446d-bdfc-b0d1986520cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:35.647462 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-af7f6842-9710-4098-bb4c-fb9255bd41c0 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:35.648115 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-af7f6842-9710-4098-bb4c-fb9255bd41c0 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:35.656161 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-af7f6842-9710-4098-bb4c-fb9255bd41c0 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:35.656636 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-af7f6842-9710-4098-bb4c-fb9255bd41c0 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:35.657535 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-af7f6842-9710-4098-bb4c-fb9255bd41c0 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:35.657995 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-af7f6842-9710-4098-bb4c-fb9255bd41c0 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:35.771779 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-af7f6842-9710-4098-bb4c-fb9255bd41c0 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:35.780323 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-af7f6842-9710-4098-bb4c-fb9255bd41c0 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1218 microversion: 2.1 time: 0.136842 Dec 14 10:11:35.780882 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 217/444] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:35 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1218 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:35.786856 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5d582a0a-db61-446d-bdfc-b0d1986520cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:35.796214 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5d582a0a-db61-446d-bdfc-b0d1986520cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.221982 Dec 14 10:11:35.796761 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 228/445] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:35 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:35.878253 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3c5ee52f-5670-4432-a00b-249b8a8c155e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:35.878857 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3c5ee52f-5670-4432-a00b-249b8a8c155e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:35.885898 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3c5ee52f-5670-4432-a00b-249b8a8c155e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:35.886369 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3c5ee52f-5670-4432-a00b-249b8a8c155e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:35.887172 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3c5ee52f-5670-4432-a00b-249b8a8c155e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:35.887777 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3c5ee52f-5670-4432-a00b-249b8a8c155e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:36.068290 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-df363d41-9e7c-4448-b915-c8d7617b253d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:36.068975 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-df363d41-9e7c-4448-b915-c8d7617b253d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:36.076500 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-df363d41-9e7c-4448-b915-c8d7617b253d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:36.076940 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-df363d41-9e7c-4448-b915-c8d7617b253d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:36.077714 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-df363d41-9e7c-4448-b915-c8d7617b253d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:36.078177 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-df363d41-9e7c-4448-b915-c8d7617b253d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:36.081300 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3c5ee52f-5670-4432-a00b-249b8a8c155e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:36.091098 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3c5ee52f-5670-4432-a00b-249b8a8c155e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1358 microversion: 2.1 time: 0.215574 Dec 14 10:11:36.091965 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 218/446] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:35 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:36.382128 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-df363d41-9e7c-4448-b915-c8d7617b253d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:36.385493 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-01e1a4fe-a4f0-40bd-9c72-e93c9364e2aa tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:36.386721 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-01e1a4fe-a4f0-40bd-9c72-e93c9364e2aa tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:36.392581 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-df363d41-9e7c-4448-b915-c8d7617b253d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.327830 Dec 14 10:11:36.393879 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 229/447] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:36 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:36.397564 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-01e1a4fe-a4f0-40bd-9c72-e93c9364e2aa tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:36.398153 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-01e1a4fe-a4f0-40bd-9c72-e93c9364e2aa tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:36.399218 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-01e1a4fe-a4f0-40bd-9c72-e93c9364e2aa tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:36.400119 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-01e1a4fe-a4f0-40bd-9c72-e93c9364e2aa tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:36.798856 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-7983c7d6-3f4f-47db-be77-9e28094c7204 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:36.799576 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-7983c7d6-3f4f-47db-be77-9e28094c7204 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:36.807237 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7983c7d6-3f4f-47db-be77-9e28094c7204 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:36.807684 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7983c7d6-3f4f-47db-be77-9e28094c7204 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:36.808460 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7983c7d6-3f4f-47db-be77-9e28094c7204 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:36.809424 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7983c7d6-3f4f-47db-be77-9e28094c7204 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:36.835525 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-01e1a4fe-a4f0-40bd-9c72-e93c9364e2aa tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:36.844905 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-01e1a4fe-a4f0-40bd-9c72-e93c9364e2aa tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1271 microversion: 2.1 time: 0.464622 Dec 14 10:11:36.845842 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 219/448] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:36 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1271 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:36.860705 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6da537c6-57f3-4ae2-af86-d769420a9d38 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:36.861582 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6da537c6-57f3-4ae2-af86-d769420a9d38 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:36.869627 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6da537c6-57f3-4ae2-af86-d769420a9d38 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:36.870430 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6da537c6-57f3-4ae2-af86-d769420a9d38 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:36.871220 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6da537c6-57f3-4ae2-af86-d769420a9d38 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:36.872248 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6da537c6-57f3-4ae2-af86-d769420a9d38 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:36.947239 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-7983c7d6-3f4f-47db-be77-9e28094c7204 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:36.956280 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-7983c7d6-3f4f-47db-be77-9e28094c7204 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1266 microversion: 2.1 time: 0.162739 Dec 14 10:11:36.957168 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 230/449] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:36 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:37.111462 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8604dad6-c396-437e-b630-8854142df5d0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:37.112932 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-8604dad6-c396-437e-b630-8854142df5d0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:37.120874 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8604dad6-c396-437e-b630-8854142df5d0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:37.121675 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8604dad6-c396-437e-b630-8854142df5d0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:37.123557 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8604dad6-c396-437e-b630-8854142df5d0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:37.124382 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8604dad6-c396-437e-b630-8854142df5d0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:37.400963 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-6da537c6-57f3-4ae2-af86-d769420a9d38 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:37.412422 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6da537c6-57f3-4ae2-af86-d769420a9d38 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.555875 Dec 14 10:11:37.420270 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 220/450] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:36 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:37.425508 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-4df68182-19d3-4e65-83fe-2ebd1b48d06e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:37.429704 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-4df68182-19d3-4e65-83fe-2ebd1b48d06e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:37.441909 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4df68182-19d3-4e65-83fe-2ebd1b48d06e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:37.442851 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4df68182-19d3-4e65-83fe-2ebd1b48d06e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:37.443819 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4df68182-19d3-4e65-83fe-2ebd1b48d06e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:37.444407 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4df68182-19d3-4e65-83fe-2ebd1b48d06e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:37.766254 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-8604dad6-c396-437e-b630-8854142df5d0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:37.776539 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8604dad6-c396-437e-b630-8854142df5d0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1358 microversion: 2.1 time: 0.671930 Dec 14 10:11:37.790822 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 231/451] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:37 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1358 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:37.799519 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-0c005b38-5d51-42c9-a66d-5abd77b6bce8 req-07860229-7b1f-4e7b-b23c-a65601888d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b8c891-6fe6-4b09-8254-77c354e67aaa", "tag": "35d84917-4bee-46b2-a5e4-3ff2c82add1c"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:37.801116 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:11:37.801116 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:11:37.817335 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-0c005b38-5d51-42c9-a66d-5abd77b6bce8 req-07860229-7b1f-4e7b-b23c-a65601888d94 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:37.818117 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-0c005b38-5d51-42c9-a66d-5abd77b6bce8 req-07860229-7b1f-4e7b-b23c-a65601888d94 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:37.845637 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-0c005b38-5d51-42c9-a66d-5abd77b6bce8 req-07860229-7b1f-4e7b-b23c-a65601888d94 service nova] Creating event network-changed:35d84917-4bee-46b2-a5e4-3ff2c82add1c for instance 12b8c891-6fe6-4b09-8254-77c354e67aaa on hv-cinder-81888 Dec 14 10:11:37.850437 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-0c005b38-5d51-42c9-a66d-5abd77b6bce8 req-07860229-7b1f-4e7b-b23c-a65601888d94 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057741 Dec 14 10:11:37.857871 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 232/452] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:11:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:11:37.864221 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d1d42cfc-6d11-4710-88e9-a9d52687e8cd tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:37.864999 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d1d42cfc-6d11-4710-88e9-a9d52687e8cd tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:37.873492 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-4df68182-19d3-4e65-83fe-2ebd1b48d06e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:37.878279 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d1d42cfc-6d11-4710-88e9-a9d52687e8cd tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:37.878977 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d1d42cfc-6d11-4710-88e9-a9d52687e8cd tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:37.882494 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-4df68182-19d3-4e65-83fe-2ebd1b48d06e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.460847 Dec 14 10:11:37.885413 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 221/453] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:37 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:37.885898 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d1d42cfc-6d11-4710-88e9-a9d52687e8cd tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:37.886478 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d1d42cfc-6d11-4710-88e9-a9d52687e8cd tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:37.972564 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-444ebfd1-a292-400b-b414-01968b295db2 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:37.974221 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-444ebfd1-a292-400b-b414-01968b295db2 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:37.981497 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-444ebfd1-a292-400b-b414-01968b295db2 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:37.982428 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-444ebfd1-a292-400b-b414-01968b295db2 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:37.983462 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-444ebfd1-a292-400b-b414-01968b295db2 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:37.984088 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-444ebfd1-a292-400b-b414-01968b295db2 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:38.155668 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-444ebfd1-a292-400b-b414-01968b295db2 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:38.164891 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-444ebfd1-a292-400b-b414-01968b295db2 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1272 microversion: 2.1 time: 0.195908 Dec 14 10:11:38.165518 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 222/454] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:37 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1272 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:38.170991 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-44981851-b5c5-4a7c-95e7-5360e829480d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:38.171556 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-44981851-b5c5-4a7c-95e7-5360e829480d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:38.180042 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-44981851-b5c5-4a7c-95e7-5360e829480d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:38.181050 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-44981851-b5c5-4a7c-95e7-5360e829480d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:38.181929 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-44981851-b5c5-4a7c-95e7-5360e829480d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:38.182601 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-44981851-b5c5-4a7c-95e7-5360e829480d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:38.338617 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d1d42cfc-6d11-4710-88e9-a9d52687e8cd tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:38.344051 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.objects.instance [None req-44981851-b5c5-4a7c-95e7-5360e829480d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lazy-loading 'services' on Instance uuid b2cb221d-d3cd-4592-8e0b-479868639222 {{(pid=100985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:11:38.348295 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d1d42cfc-6d11-4710-88e9-a9d52687e8cd tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1271 microversion: 2.1 time: 0.488811 Dec 14 10:11:38.358303 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 233/455] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:37 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1271 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:38.432130 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-996cd789-5d90-4973-b105-e84bf7e8d3a8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:38.433019 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-996cd789-5d90-4973-b105-e84bf7e8d3a8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:38.441476 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-996cd789-5d90-4973-b105-e84bf7e8d3a8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:38.443570 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-996cd789-5d90-4973-b105-e84bf7e8d3a8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:38.444565 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-996cd789-5d90-4973-b105-e84bf7e8d3a8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:38.445232 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-996cd789-5d90-4973-b105-e84bf7e8d3a8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:38.526581 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-44981851-b5c5-4a7c-95e7-5360e829480d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222/os-volume_attachments/dc8bba1b-c75e-4a19-97fa-a3b944a1ae7c" status: 202 len: 0 microversion: 2.1 time: 0.359494 Dec 14 10:11:38.527191 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 223/456] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Dec 14 10:11:38 2021] DELETE /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222/os-volume_attachments/dc8bba1b-c75e-4a19-97fa-a3b944a1ae7c => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:11:38.551036 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-1d40eace-7646-4bf0-8e7c-8d194c0afa97 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:38.552397 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-1d40eace-7646-4bf0-8e7c-8d194c0afa97 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:38.561250 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1d40eace-7646-4bf0-8e7c-8d194c0afa97 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:38.561942 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1d40eace-7646-4bf0-8e7c-8d194c0afa97 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:38.562918 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1d40eace-7646-4bf0-8e7c-8d194c0afa97 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:38.563578 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1d40eace-7646-4bf0-8e7c-8d194c0afa97 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:38.666611 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-1d40eace-7646-4bf0-8e7c-8d194c0afa97 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134462 Dec 14 10:11:38.667598 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 224/457] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:11:38 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:11:38.795777 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-996cd789-5d90-4973-b105-e84bf7e8d3a8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:38.797061 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-aef67a5b-12a1-49d7-98aa-1c53c1b0fb5d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:38.797732 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-aef67a5b-12a1-49d7-98aa-1c53c1b0fb5d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:38.805646 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-996cd789-5d90-4973-b105-e84bf7e8d3a8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.377620 Dec 14 10:11:38.806446 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 234/458] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:38 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:38.810342 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-aef67a5b-12a1-49d7-98aa-1c53c1b0fb5d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:38.810809 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-aef67a5b-12a1-49d7-98aa-1c53c1b0fb5d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:38.811556 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-aef67a5b-12a1-49d7-98aa-1c53c1b0fb5d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:38.811985 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-aef67a5b-12a1-49d7-98aa-1c53c1b0fb5d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:38.902827 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c7d0394d-128d-49d9-9bfa-4ebaeaffb231 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:38.903823 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c7d0394d-128d-49d9-9bfa-4ebaeaffb231 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:38.911954 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c7d0394d-128d-49d9-9bfa-4ebaeaffb231 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:38.912406 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c7d0394d-128d-49d9-9bfa-4ebaeaffb231 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:38.913297 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c7d0394d-128d-49d9-9bfa-4ebaeaffb231 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:38.913864 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c7d0394d-128d-49d9-9bfa-4ebaeaffb231 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:39.220971 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-aef67a5b-12a1-49d7-98aa-1c53c1b0fb5d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:39.230382 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-aef67a5b-12a1-49d7-98aa-1c53c1b0fb5d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1358 microversion: 2.1 time: 0.437606 Dec 14 10:11:39.240324 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c7d0394d-128d-49d9-9bfa-4ebaeaffb231 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:39.241894 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 225/459] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:38 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1358 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:39.247389 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-60fb4327-8f81-46cf-9f22-ab8714ca3531 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:39.248399 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-60fb4327-8f81-46cf-9f22-ab8714ca3531 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:39.248767 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c7d0394d-128d-49d9-9bfa-4ebaeaffb231 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.351096 Dec 14 10:11:39.249705 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 235/460] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:38 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:39.261103 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-60fb4327-8f81-46cf-9f22-ab8714ca3531 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:39.261577 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-60fb4327-8f81-46cf-9f22-ab8714ca3531 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:39.263073 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-60fb4327-8f81-46cf-9f22-ab8714ca3531 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:39.263691 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-60fb4327-8f81-46cf-9f22-ab8714ca3531 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:39.364461 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-27187fc5-5570-4513-8ee4-7b4b48a94343 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:39.365760 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-27187fc5-5570-4513-8ee4-7b4b48a94343 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:39.373537 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-27187fc5-5570-4513-8ee4-7b4b48a94343 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:39.374320 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-27187fc5-5570-4513-8ee4-7b4b48a94343 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:39.375327 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-27187fc5-5570-4513-8ee4-7b4b48a94343 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:39.375968 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-27187fc5-5570-4513-8ee4-7b4b48a94343 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:39.588587 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-60fb4327-8f81-46cf-9f22-ab8714ca3531 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:39.597831 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-60fb4327-8f81-46cf-9f22-ab8714ca3531 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1314 microversion: 2.1 time: 0.354536 Dec 14 10:11:39.598561 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 226/461] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:39 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:39.679242 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-cbb4aabb-e815-424b-acc2-ce0028ebd77a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:39.680740 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-cbb4aabb-e815-424b-acc2-ce0028ebd77a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:39.690520 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cbb4aabb-e815-424b-acc2-ce0028ebd77a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:39.691146 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cbb4aabb-e815-424b-acc2-ce0028ebd77a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:39.692217 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cbb4aabb-e815-424b-acc2-ce0028ebd77a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:39.693052 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cbb4aabb-e815-424b-acc2-ce0028ebd77a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:39.727471 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-27187fc5-5570-4513-8ee4-7b4b48a94343 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:39.754248 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-27187fc5-5570-4513-8ee4-7b4b48a94343 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1259 microversion: 2.1 time: 0.381865 Dec 14 10:11:39.754248 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 236/462] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:39 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1259 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:39.759450 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-3af41750-03ea-45ea-9c7e-ad02c9f29c1c tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:39.760015 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-3af41750-03ea-45ea-9c7e-ad02c9f29c1c tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:39.768015 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3af41750-03ea-45ea-9c7e-ad02c9f29c1c tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:39.768468 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3af41750-03ea-45ea-9c7e-ad02c9f29c1c tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:39.772695 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3af41750-03ea-45ea-9c7e-ad02c9f29c1c tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:39.773205 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3af41750-03ea-45ea-9c7e-ad02c9f29c1c tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:39.799784 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-cbb4aabb-e815-424b-acc2-ce0028ebd77a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124583 Dec 14 10:11:39.800882 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 227/463] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:11:39 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:11:39.823686 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e5a14ee7-2ddd-4297-ba3b-694dd8a6ad72 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:39.825367 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e5a14ee7-2ddd-4297-ba3b-694dd8a6ad72 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:39.835764 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e5a14ee7-2ddd-4297-ba3b-694dd8a6ad72 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:39.836885 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e5a14ee7-2ddd-4297-ba3b-694dd8a6ad72 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:39.837760 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e5a14ee7-2ddd-4297-ba3b-694dd8a6ad72 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:39.838674 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e5a14ee7-2ddd-4297-ba3b-694dd8a6ad72 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:39.859690 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-3af41750-03ea-45ea-9c7e-ad02c9f29c1c tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Going to try to terminate instance {{(pid=100984) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:11:40.047598 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-3af41750-03ea-45ea-9c7e-ad02c9f29c1c tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "DELETE /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 204 len: 0 microversion: 2.1 time: 0.291406 Dec 14 10:11:40.048190 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 237/464] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:11:39 2021] DELETE /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 14 10:11:40.056855 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-0109e69e-5061-4919-b113-62edc599ca60 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:40.057605 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-0109e69e-5061-4919-b113-62edc599ca60 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:40.072496 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0109e69e-5061-4919-b113-62edc599ca60 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:40.072946 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0109e69e-5061-4919-b113-62edc599ca60 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:40.073737 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0109e69e-5061-4919-b113-62edc599ca60 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:40.075416 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0109e69e-5061-4919-b113-62edc599ca60 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:40.162349 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-e5a14ee7-2ddd-4297-ba3b-694dd8a6ad72 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:40.176030 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e5a14ee7-2ddd-4297-ba3b-694dd8a6ad72 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.356324 Dec 14 10:11:40.177214 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 228/465] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:39 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:40.248460 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-1177733a-e172-4b04-8292-cdd437c90345 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:40.249104 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-1177733a-e172-4b04-8292-cdd437c90345 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:40.256247 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1177733a-e172-4b04-8292-cdd437c90345 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:40.256694 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1177733a-e172-4b04-8292-cdd437c90345 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:40.257467 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1177733a-e172-4b04-8292-cdd437c90345 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:40.257904 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1177733a-e172-4b04-8292-cdd437c90345 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:40.480945 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-1177733a-e172-4b04-8292-cdd437c90345 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:40.501446 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-0109e69e-5061-4919-b113-62edc599ca60 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:40.508898 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-1177733a-e172-4b04-8292-cdd437c90345 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1358 microversion: 2.1 time: 0.264673 Dec 14 10:11:40.511810 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 229/466] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:40 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:40.513381 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-0109e69e-5061-4919-b113-62edc599ca60 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1514 microversion: 2.1 time: 0.458891 Dec 14 10:11:40.514118 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 238/467] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:40 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1514 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:40.517529 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-94fe5d85-694f-46f5-aa35-fcbf183f4143 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:40.518356 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-94fe5d85-694f-46f5-aa35-fcbf183f4143 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:40.519223 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-f7f02998-cc66-475d-9558-2c451deee8d1 req-f1f3dbfd-a44b-45fc-8c30-07af82a15858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a09e3d56-a48c-4117-bd3f-6cecf8857a25", "tag": "8700a3d2-b567-4851-a02f-46bf22ce6c5b"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:40.525065 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:11:40.525065 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:11:40.526989 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-94fe5d85-694f-46f5-aa35-fcbf183f4143 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:40.528140 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-94fe5d85-694f-46f5-aa35-fcbf183f4143 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:40.528939 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-94fe5d85-694f-46f5-aa35-fcbf183f4143 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:40.529379 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-94fe5d85-694f-46f5-aa35-fcbf183f4143 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:40.544092 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-f7f02998-cc66-475d-9558-2c451deee8d1 req-f1f3dbfd-a44b-45fc-8c30-07af82a15858 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:40.544546 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-f7f02998-cc66-475d-9558-2c451deee8d1 req-f1f3dbfd-a44b-45fc-8c30-07af82a15858 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:40.562195 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-f7f02998-cc66-475d-9558-2c451deee8d1 req-f1f3dbfd-a44b-45fc-8c30-07af82a15858 service nova] Creating event network-changed:8700a3d2-b567-4851-a02f-46bf22ce6c5b for instance a09e3d56-a48c-4117-bd3f-6cecf8857a25 on hv-cinder-81888 Dec 14 10:11:40.567602 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-f7f02998-cc66-475d-9558-2c451deee8d1 req-f1f3dbfd-a44b-45fc-8c30-07af82a15858 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051892 Dec 14 10:11:40.568520 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 239/468] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:11:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:11:40.616824 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-0d612953-1384-4e0e-95b8-93f64e353684 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:40.619555 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-0d612953-1384-4e0e-95b8-93f64e353684 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:40.629282 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0d612953-1384-4e0e-95b8-93f64e353684 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:40.629824 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0d612953-1384-4e0e-95b8-93f64e353684 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:40.630821 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0d612953-1384-4e0e-95b8-93f64e353684 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:40.631326 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0d612953-1384-4e0e-95b8-93f64e353684 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:40.747670 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-94fe5d85-694f-46f5-aa35-fcbf183f4143 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:40.756557 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-94fe5d85-694f-46f5-aa35-fcbf183f4143 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.242731 Dec 14 10:11:40.757319 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 230/469] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:40 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:40.763538 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-50cbe1a2-afad-43b7-9edc-ffad1c8e3437 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:40.764304 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-50cbe1a2-afad-43b7-9edc-ffad1c8e3437 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:40.771417 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-50cbe1a2-afad-43b7-9edc-ffad1c8e3437 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:40.771877 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-50cbe1a2-afad-43b7-9edc-ffad1c8e3437 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:40.772628 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-50cbe1a2-afad-43b7-9edc-ffad1c8e3437 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:40.773177 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-50cbe1a2-afad-43b7-9edc-ffad1c8e3437 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:40.975936 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-50cbe1a2-afad-43b7-9edc-ffad1c8e3437 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:40.985267 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-50cbe1a2-afad-43b7-9edc-ffad1c8e3437 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1259 microversion: 2.1 time: 0.226022 Dec 14 10:11:40.995221 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 231/470] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:40 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:41.001307 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-fd55f451-a11a-4076-9fe9-8ebb2af88b6d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:41.002428 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-fd55f451-a11a-4076-9fe9-8ebb2af88b6d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:41.010912 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fd55f451-a11a-4076-9fe9-8ebb2af88b6d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:41.011540 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fd55f451-a11a-4076-9fe9-8ebb2af88b6d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:41.012650 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fd55f451-a11a-4076-9fe9-8ebb2af88b6d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:41.013092 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fd55f451-a11a-4076-9fe9-8ebb2af88b6d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:41.077191 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-fd55f451-a11a-4076-9fe9-8ebb2af88b6d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080532 Dec 14 10:11:41.077752 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 232/471] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:11:40 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 10:11:41.134848 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-0d612953-1384-4e0e-95b8-93f64e353684 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:41.144130 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-0d612953-1384-4e0e-95b8-93f64e353684 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1314 microversion: 2.1 time: 0.532130 Dec 14 10:11:41.160486 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 240/472] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:40 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:41.194420 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b5bc446a-5631-4cb4-9577-8ca33a219ff3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:41.195363 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-b5bc446a-5631-4cb4-9577-8ca33a219ff3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:41.202965 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b5bc446a-5631-4cb4-9577-8ca33a219ff3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:41.203535 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b5bc446a-5631-4cb4-9577-8ca33a219ff3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:41.204395 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b5bc446a-5631-4cb4-9577-8ca33a219ff3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:41.204921 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b5bc446a-5631-4cb4-9577-8ca33a219ff3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:41.416121 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-b5bc446a-5631-4cb4-9577-8ca33a219ff3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:41.425336 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-b5bc446a-5631-4cb4-9577-8ca33a219ff3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1725 microversion: 2.1 time: 0.234758 Dec 14 10:11:41.425923 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 233/473] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:41 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:41.529895 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c20a9f20-73c6-4621-a087-63870fa434cf tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:41.531285 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c20a9f20-73c6-4621-a087-63870fa434cf tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:41.531873 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-ba5abd2d-4903-491c-a5ac-5b5a4bba4223 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:41.532484 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-ba5abd2d-4903-491c-a5ac-5b5a4bba4223 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:41.540291 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ba5abd2d-4903-491c-a5ac-5b5a4bba4223 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:41.540753 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ba5abd2d-4903-491c-a5ac-5b5a4bba4223 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:41.541573 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ba5abd2d-4903-491c-a5ac-5b5a4bba4223 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:41.542043 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ba5abd2d-4903-491c-a5ac-5b5a4bba4223 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:41.543698 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c20a9f20-73c6-4621-a087-63870fa434cf tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:41.544466 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c20a9f20-73c6-4621-a087-63870fa434cf tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:41.545634 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c20a9f20-73c6-4621-a087-63870fa434cf tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:41.546381 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c20a9f20-73c6-4621-a087-63870fa434cf tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:41.753383 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-ba5abd2d-4903-491c-a5ac-5b5a4bba4223 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:41.761596 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-ba5abd2d-4903-491c-a5ac-5b5a4bba4223 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1514 microversion: 2.1 time: 0.234589 Dec 14 10:11:41.762929 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 234/474] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:41 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1514 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:41.773912 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a4093f26-dabd-4e08-af7a-f34a155f83e1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:41.774634 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a4093f26-dabd-4e08-af7a-f34a155f83e1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:41.782180 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a4093f26-dabd-4e08-af7a-f34a155f83e1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:41.782724 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a4093f26-dabd-4e08-af7a-f34a155f83e1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:41.783570 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a4093f26-dabd-4e08-af7a-f34a155f83e1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:41.784080 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a4093f26-dabd-4e08-af7a-f34a155f83e1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:41.908297 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c20a9f20-73c6-4621-a087-63870fa434cf tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:41.922195 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c20a9f20-73c6-4621-a087-63870fa434cf tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1358 microversion: 2.1 time: 0.397964 Dec 14 10:11:41.923054 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 241/475] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:41 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1358 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:42.002391 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-07443b60-d011-4e3d-8afd-c52cecda4ffb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:42.003128 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-07443b60-d011-4e3d-8afd-c52cecda4ffb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:42.015543 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-07443b60-d011-4e3d-8afd-c52cecda4ffb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:42.016168 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-07443b60-d011-4e3d-8afd-c52cecda4ffb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:42.017060 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-07443b60-d011-4e3d-8afd-c52cecda4ffb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:42.017574 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-07443b60-d011-4e3d-8afd-c52cecda4ffb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:42.261704 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-a4093f26-dabd-4e08-af7a-f34a155f83e1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:42.270072 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a4093f26-dabd-4e08-af7a-f34a155f83e1 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.499652 Dec 14 10:11:42.270866 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 235/476] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:41 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:42.285290 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c5cb6740-4c8f-436f-96fe-97889d8692bc tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:42.285903 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c5cb6740-4c8f-436f-96fe-97889d8692bc tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:42.294792 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c5cb6740-4c8f-436f-96fe-97889d8692bc tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:42.295240 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c5cb6740-4c8f-436f-96fe-97889d8692bc tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:42.296023 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c5cb6740-4c8f-436f-96fe-97889d8692bc tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:42.296456 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c5cb6740-4c8f-436f-96fe-97889d8692bc tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:42.364377 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-07443b60-d011-4e3d-8afd-c52cecda4ffb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:42.373287 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-07443b60-d011-4e3d-8afd-c52cecda4ffb tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1259 microversion: 2.1 time: 0.374462 Dec 14 10:11:42.379866 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 242/477] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:41 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1259 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:42.408289 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a2bfdc42-051a-4110-ad17-fa5578c088f2 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:42.408923 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-a2bfdc42-051a-4110-ad17-fa5578c088f2 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:42.417376 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a2bfdc42-051a-4110-ad17-fa5578c088f2 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:42.418092 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a2bfdc42-051a-4110-ad17-fa5578c088f2 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:42.419559 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a2bfdc42-051a-4110-ad17-fa5578c088f2 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:42.420090 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a2bfdc42-051a-4110-ad17-fa5578c088f2 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:42.483885 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-a2bfdc42-051a-4110-ad17-fa5578c088f2 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Going to try to terminate instance {{(pid=100984) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:11:42.604910 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a2bfdc42-051a-4110-ad17-fa5578c088f2 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 204 len: 0 microversion: 2.1 time: 0.200044 Dec 14 10:11:42.606289 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 243/478] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:11:42 2021] DELETE /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 14 10:11:42.611164 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-62015e78-0f63-4b38-b4db-d236da2fca3d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:42.611849 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-62015e78-0f63-4b38-b4db-d236da2fca3d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:42.618856 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-62015e78-0f63-4b38-b4db-d236da2fca3d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:42.619293 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-62015e78-0f63-4b38-b4db-d236da2fca3d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:42.620074 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-62015e78-0f63-4b38-b4db-d236da2fca3d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:42.620498 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-62015e78-0f63-4b38-b4db-d236da2fca3d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:42.705898 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-c5cb6740-4c8f-436f-96fe-97889d8692bc tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:42.716629 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c5cb6740-4c8f-436f-96fe-97889d8692bc tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1314 microversion: 2.1 time: 0.434724 Dec 14 10:11:42.717413 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 236/479] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:42 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:42.730239 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-01fb1a0a-fd7d-47d9-8971-0455c15384dd tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:42.731593 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-01fb1a0a-fd7d-47d9-8971-0455c15384dd tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:42.739089 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-01fb1a0a-fd7d-47d9-8971-0455c15384dd tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:42.739555 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-01fb1a0a-fd7d-47d9-8971-0455c15384dd tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:42.740334 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-01fb1a0a-fd7d-47d9-8971-0455c15384dd tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:42.740771 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-01fb1a0a-fd7d-47d9-8971-0455c15384dd tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:42.826469 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-62015e78-0f63-4b38-b4db-d236da2fca3d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:42.835407 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-62015e78-0f63-4b38-b4db-d236da2fca3d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1702 microversion: 2.1 time: 0.228100 Dec 14 10:11:42.835981 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 244/480] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:42 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1702 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:42.840947 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-6d1aec0f-d2d3-42fe-9a07-f95afdbef49c tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:42.841550 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-6d1aec0f-d2d3-42fe-9a07-f95afdbef49c tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:42.849582 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6d1aec0f-d2d3-42fe-9a07-f95afdbef49c tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:42.849929 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6d1aec0f-d2d3-42fe-9a07-f95afdbef49c tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:42.850717 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6d1aec0f-d2d3-42fe-9a07-f95afdbef49c tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:42.851148 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6d1aec0f-d2d3-42fe-9a07-f95afdbef49c tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:42.963838 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-6d1aec0f-d2d3-42fe-9a07-f95afdbef49c tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:42.972325 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-6d1aec0f-d2d3-42fe-9a07-f95afdbef49c tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 200 len: 1472 microversion: 2.1 time: 0.135368 Dec 14 10:11:42.972892 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 245/481] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:42 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 1472 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:42.982270 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-9866f41d-45d3-4653-8791-7b6718332c17 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:42.987604 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9866f41d-45d3-4653-8791-7b6718332c17 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:42.987758 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9866f41d-45d3-4653-8791-7b6718332c17 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:43.052190 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-9866f41d-45d3-4653-8791-7b6718332c17 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Going to try to start instance {{(pid=100984) start /opt/stack/nova/nova/compute/api.py:2625}} Dec 14 10:11:43.077613 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-01fb1a0a-fd7d-47d9-8971-0455c15384dd tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:43.087412 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-01fb1a0a-fd7d-47d9-8971-0455c15384dd tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 200 len: 1513 microversion: 2.1 time: 0.360724 Dec 14 10:11:43.088304 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 237/482] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:42 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 1513 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:43.094396 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-9ccb7f13-1e13-4a9a-b838-98c4b478df46 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:43.094743 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-9ccb7f13-1e13-4a9a-b838-98c4b478df46 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:43.103560 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9ccb7f13-1e13-4a9a-b838-98c4b478df46 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:43.104145 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9ccb7f13-1e13-4a9a-b838-98c4b478df46 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:43.105009 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9ccb7f13-1e13-4a9a-b838-98c4b478df46 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:43.106126 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9ccb7f13-1e13-4a9a-b838-98c4b478df46 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:43.145840 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-9866f41d-45d3-4653-8791-7b6718332c17 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 202 len: 0 microversion: 2.1 time: 0.171645 Dec 14 10:11:43.149413 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 246/483] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:11:42 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:11:43.154252 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-a33dbebb-6ab9-4cfe-b802-1413b9ce5b4e req-b8eb63ea-2aa5-4cfa-aa0e-b20ed82b9b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db6ba6ce-0853-4c2d-9cdd-489058bb57df", "name": "network-vif-deleted", "tag": "9d76f03f-87f4-41ec-ad81-30ce3cc98300"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:43.156132 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:11:43.156132 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:11:43.165027 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-a33dbebb-6ab9-4cfe-b802-1413b9ce5b4e req-b8eb63ea-2aa5-4cfa-aa0e-b20ed82b9b5d service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:43.165546 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-a33dbebb-6ab9-4cfe-b802-1413b9ce5b4e req-b8eb63ea-2aa5-4cfa-aa0e-b20ed82b9b5d service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:43.187478 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-a33dbebb-6ab9-4cfe-b802-1413b9ce5b4e req-b8eb63ea-2aa5-4cfa-aa0e-b20ed82b9b5d service nova] Creating event network-vif-deleted:9d76f03f-87f4-41ec-ad81-30ce3cc98300 for instance db6ba6ce-0853-4c2d-9cdd-489058bb57df on hv-cinder-81888 Dec 14 10:11:43.192090 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-a33dbebb-6ab9-4cfe-b802-1413b9ce5b4e req-b8eb63ea-2aa5-4cfa-aa0e-b20ed82b9b5d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043754 Dec 14 10:11:43.193092 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 247/484] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:11:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:11:43.197792 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4519f469-7134-42c7-8b2c-0a58b6578525 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:43.198499 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4519f469-7134-42c7-8b2c-0a58b6578525 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:43.206225 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4519f469-7134-42c7-8b2c-0a58b6578525 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:43.206665 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4519f469-7134-42c7-8b2c-0a58b6578525 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:43.208715 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4519f469-7134-42c7-8b2c-0a58b6578525 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:43.208715 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4519f469-7134-42c7-8b2c-0a58b6578525 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:43.362217 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-9ccb7f13-1e13-4a9a-b838-98c4b478df46 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:43.370699 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-9ccb7f13-1e13-4a9a-b838-98c4b478df46 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1358 microversion: 2.1 time: 0.281076 Dec 14 10:11:43.372041 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 238/485] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:43 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1358 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:43.376642 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-8ee47636-c69b-4099-b512-45ced311c480 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:43.377249 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-8ee47636-c69b-4099-b512-45ced311c480 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:43.384586 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8ee47636-c69b-4099-b512-45ced311c480 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:43.385041 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8ee47636-c69b-4099-b512-45ced311c480 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:43.385814 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8ee47636-c69b-4099-b512-45ced311c480 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:43.386304 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8ee47636-c69b-4099-b512-45ced311c480 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:43.420826 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4519f469-7134-42c7-8b2c-0a58b6578525 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:43.431875 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4519f469-7134-42c7-8b2c-0a58b6578525 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1711 microversion: 2.1 time: 0.237633 Dec 14 10:11:43.432709 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 248/486] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:43 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1711 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:43.438615 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-9da65588-a8cf-4659-a59b-ecfa1ade1f15 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:43.439208 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-9da65588-a8cf-4659-a59b-ecfa1ade1f15 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:43.448104 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9da65588-a8cf-4659-a59b-ecfa1ade1f15 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:43.448559 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9da65588-a8cf-4659-a59b-ecfa1ade1f15 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:43.449391 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9da65588-a8cf-4659-a59b-ecfa1ade1f15 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:43.450358 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9da65588-a8cf-4659-a59b-ecfa1ade1f15 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:43.722610 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-9da65588-a8cf-4659-a59b-ecfa1ade1f15 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:43.730991 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-9da65588-a8cf-4659-a59b-ecfa1ade1f15 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1259 microversion: 2.1 time: 0.296035 Dec 14 10:11:43.731608 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 249/487] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:43 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1259 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:43.736019 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f3c579f1-91db-440d-b589-4b41a97e4527 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:43.736624 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f3c579f1-91db-440d-b589-4b41a97e4527 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:43.744376 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f3c579f1-91db-440d-b589-4b41a97e4527 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:43.744849 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f3c579f1-91db-440d-b589-4b41a97e4527 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:43.745683 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f3c579f1-91db-440d-b589-4b41a97e4527 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:43.746142 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f3c579f1-91db-440d-b589-4b41a97e4527 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:43.767157 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-8ee47636-c69b-4099-b512-45ced311c480 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:43.776244 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-8ee47636-c69b-4099-b512-45ced311c480 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.402894 Dec 14 10:11:43.776813 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 239/488] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:43 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:43.946026 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-f3c579f1-91db-440d-b589-4b41a97e4527 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:43.956207 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f3c579f1-91db-440d-b589-4b41a97e4527 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1314 microversion: 2.1 time: 0.223541 Dec 14 10:11:43.957028 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 250/489] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:43 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:43.992287 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c6a10e1d-fe4b-4663-888a-b00c5fac4365 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:43.993190 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c6a10e1d-fe4b-4663-888a-b00c5fac4365 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: db6ba6ce-0853-4c2d-9cdd-489058bb57df] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:44.005524 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c6a10e1d-fe4b-4663-888a-b00c5fac4365 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:44.006306 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c6a10e1d-fe4b-4663-888a-b00c5fac4365 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:44.007921 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c6a10e1d-fe4b-4663-888a-b00c5fac4365 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:44.008498 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c6a10e1d-fe4b-4663-888a-b00c5fac4365 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:44.076573 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-c6a10e1d-fe4b-4663-888a-b00c5fac4365 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] HTTP exception thrown: Instance db6ba6ce-0853-4c2d-9cdd-489058bb57df could not be found. Dec 14 10:11:44.077456 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c6a10e1d-fe4b-4663-888a-b00c5fac4365 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Returning 404 to user: Instance db6ba6ce-0853-4c2d-9cdd-489058bb57df could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:11:44.078202 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c6a10e1d-fe4b-4663-888a-b00c5fac4365 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df" status: 404 len: 111 microversion: 2.1 time: 0.091786 Dec 14 10:11:44.078761 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 240/490] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:43 2021] GET /compute/v2.1/servers/db6ba6ce-0853-4c2d-9cdd-489058bb57df => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:11:44.107586 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-109b27f2-8a49-45ce-a11c-31021da9bd6c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:44.108612 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-109b27f2-8a49-45ce-a11c-31021da9bd6c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:44.117222 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-109b27f2-8a49-45ce-a11c-31021da9bd6c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:44.117759 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-109b27f2-8a49-45ce-a11c-31021da9bd6c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:44.118975 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-109b27f2-8a49-45ce-a11c-31021da9bd6c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:44.119774 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-109b27f2-8a49-45ce-a11c-31021da9bd6c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:44.352754 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-cc6f2ac8-e9af-4d75-b599-7edd62a96ee0 req-c65d975f-6dfc-4677-a3e5-e8ef2da0ad06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b8c891-6fe6-4b09-8254-77c354e67aaa", "name": "network-vif-plugged", "status": "completed", "tag": "35d84917-4bee-46b2-a5e4-3ff2c82add1c"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:44.354504 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:11:44.354504 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:11:44.371955 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-cc6f2ac8-e9af-4d75-b599-7edd62a96ee0 req-c65d975f-6dfc-4677-a3e5-e8ef2da0ad06 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:44.372678 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-cc6f2ac8-e9af-4d75-b599-7edd62a96ee0 req-c65d975f-6dfc-4677-a3e5-e8ef2da0ad06 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:44.404073 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-cc6f2ac8-e9af-4d75-b599-7edd62a96ee0 req-c65d975f-6dfc-4677-a3e5-e8ef2da0ad06 service nova] Creating event network-vif-plugged:35d84917-4bee-46b2-a5e4-3ff2c82add1c for instance 12b8c891-6fe6-4b09-8254-77c354e67aaa on hv-cinder-81888 Dec 14 10:11:44.409419 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-cc6f2ac8-e9af-4d75-b599-7edd62a96ee0 req-c65d975f-6dfc-4677-a3e5-e8ef2da0ad06 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060162 Dec 14 10:11:44.410864 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 241/491] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:11:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:11:44.423996 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-109b27f2-8a49-45ce-a11c-31021da9bd6c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:44.434602 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-7f1ac8ee-2fdd-4037-8d1c-16bbfadf4cbb tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:44.435670 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-7f1ac8ee-2fdd-4037-8d1c-16bbfadf4cbb tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:44.438257 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-109b27f2-8a49-45ce-a11c-31021da9bd6c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 200 len: 1513 microversion: 2.1 time: 0.337406 Dec 14 10:11:44.440126 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 251/492] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:44 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 1513 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:44.453106 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f16b421a-cc91-45ad-a2a8-825ce47797fe tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:44.453743 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f16b421a-cc91-45ad-a2a8-825ce47797fe tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:44.456174 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7f1ac8ee-2fdd-4037-8d1c-16bbfadf4cbb tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:44.456781 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7f1ac8ee-2fdd-4037-8d1c-16bbfadf4cbb tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:44.459830 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7f1ac8ee-2fdd-4037-8d1c-16bbfadf4cbb tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:44.461279 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f16b421a-cc91-45ad-a2a8-825ce47797fe tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:44.461463 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7f1ac8ee-2fdd-4037-8d1c-16bbfadf4cbb tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:44.462178 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f16b421a-cc91-45ad-a2a8-825ce47797fe tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:44.463122 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f16b421a-cc91-45ad-a2a8-825ce47797fe tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:44.463792 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f16b421a-cc91-45ad-a2a8-825ce47797fe tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:44.762764 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-f16b421a-cc91-45ad-a2a8-825ce47797fe tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:44.771513 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f16b421a-cc91-45ad-a2a8-825ce47797fe tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1711 microversion: 2.1 time: 0.322587 Dec 14 10:11:44.772094 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 252/493] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:44 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1711 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:44.776772 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-aedcb3f3-6d42-4ae7-bc59-9a992b4cddf7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:44.777870 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-aedcb3f3-6d42-4ae7-bc59-9a992b4cddf7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:44.784712 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aedcb3f3-6d42-4ae7-bc59-9a992b4cddf7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:44.785154 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aedcb3f3-6d42-4ae7-bc59-9a992b4cddf7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:44.785909 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aedcb3f3-6d42-4ae7-bc59-9a992b4cddf7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:44.786358 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aedcb3f3-6d42-4ae7-bc59-9a992b4cddf7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:44.987201 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-aedcb3f3-6d42-4ae7-bc59-9a992b4cddf7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:44.995785 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-aedcb3f3-6d42-4ae7-bc59-9a992b4cddf7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1259 microversion: 2.1 time: 0.222517 Dec 14 10:11:44.997102 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 253/494] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:44 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1259 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:45.001214 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-412b0e95-52fc-41ee-8e76-da598556cc55 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:45.001930 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-412b0e95-52fc-41ee-8e76-da598556cc55 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:45.009187 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-412b0e95-52fc-41ee-8e76-da598556cc55 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:45.009739 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-412b0e95-52fc-41ee-8e76-da598556cc55 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:45.010628 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-412b0e95-52fc-41ee-8e76-da598556cc55 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:45.011182 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-412b0e95-52fc-41ee-8e76-da598556cc55 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:45.021679 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-7f1ac8ee-2fdd-4037-8d1c-16bbfadf4cbb tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:45.033731 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-7f1ac8ee-2fdd-4037-8d1c-16bbfadf4cbb tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1358 microversion: 2.1 time: 0.621530 Dec 14 10:11:45.044108 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 242/495] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:44 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1358 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:45.050471 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b75338b7-752e-47f5-a86a-acbacfbda7dd tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:45.051323 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-b75338b7-752e-47f5-a86a-acbacfbda7dd tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:45.059319 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b75338b7-752e-47f5-a86a-acbacfbda7dd tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:45.060455 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b75338b7-752e-47f5-a86a-acbacfbda7dd tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:45.061413 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b75338b7-752e-47f5-a86a-acbacfbda7dd tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:45.062026 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b75338b7-752e-47f5-a86a-acbacfbda7dd tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:45.217078 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-412b0e95-52fc-41ee-8e76-da598556cc55 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:45.225995 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-412b0e95-52fc-41ee-8e76-da598556cc55 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.228065 Dec 14 10:11:45.226642 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 254/496] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:44 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:45.423182 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-b75338b7-752e-47f5-a86a-acbacfbda7dd tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:45.432368 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-b75338b7-752e-47f5-a86a-acbacfbda7dd tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1314 microversion: 2.1 time: 0.387937 Dec 14 10:11:45.433043 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 243/497] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:45 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:45.454598 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c70390b7-3752-4c1b-8b54-79720c67b2ae tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:45.455197 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c70390b7-3752-4c1b-8b54-79720c67b2ae tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:45.462627 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c70390b7-3752-4c1b-8b54-79720c67b2ae tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:45.463122 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c70390b7-3752-4c1b-8b54-79720c67b2ae tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:45.463906 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c70390b7-3752-4c1b-8b54-79720c67b2ae tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:45.464328 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c70390b7-3752-4c1b-8b54-79720c67b2ae tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:45.563039 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-103c523f-9a6c-4e1b-9779-2b22f39bc139 req-11b4704f-2944-4d8c-8bf0-9000757fa3ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2cb221d-d3cd-4592-8e0b-479868639222", "name": "network-vif-deleted", "tag": "0e286880-f0f3-4450-b612-5e78ff43dd02"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:45.564744 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:11:45.564744 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:11:45.573487 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-103c523f-9a6c-4e1b-9779-2b22f39bc139 req-11b4704f-2944-4d8c-8bf0-9000757fa3ad service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:45.573934 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-103c523f-9a6c-4e1b-9779-2b22f39bc139 req-11b4704f-2944-4d8c-8bf0-9000757fa3ad service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:45.582247 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c70390b7-3752-4c1b-8b54-79720c67b2ae tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:45.590281 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c70390b7-3752-4c1b-8b54-79720c67b2ae tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 200 len: 1471 microversion: 2.1 time: 0.139240 Dec 14 10:11:45.590967 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-103c523f-9a6c-4e1b-9779-2b22f39bc139 req-11b4704f-2944-4d8c-8bf0-9000757fa3ad service nova] Creating event network-vif-deleted:0e286880-f0f3-4450-b612-5e78ff43dd02 for instance b2cb221d-d3cd-4592-8e0b-479868639222 on hv-cinder-81888 Dec 14 10:11:45.591083 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 255/498] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:45 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 1471 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:45.606300 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-103c523f-9a6c-4e1b-9779-2b22f39bc139 req-11b4704f-2944-4d8c-8bf0-9000757fa3ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047015 Dec 14 10:11:45.606831 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 244/499] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:11:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:11:45.788991 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c8aee458-beea-4bb8-9523-6a1cfd4c84b9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:45.789615 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c8aee458-beea-4bb8-9523-6a1cfd4c84b9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:45.797458 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c8aee458-beea-4bb8-9523-6a1cfd4c84b9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:45.797895 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c8aee458-beea-4bb8-9523-6a1cfd4c84b9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:45.798673 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c8aee458-beea-4bb8-9523-6a1cfd4c84b9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:45.799094 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c8aee458-beea-4bb8-9523-6a1cfd4c84b9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:45.987066 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c8aee458-beea-4bb8-9523-6a1cfd4c84b9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:45.995563 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c8aee458-beea-4bb8-9523-6a1cfd4c84b9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1711 microversion: 2.1 time: 0.210329 Dec 14 10:11:46.002003 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 256/500] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:45 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1711 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:46.012931 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6bb87011-cad3-457a-8275-4852db7fda63 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:46.013650 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6bb87011-cad3-457a-8275-4852db7fda63 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:46.021005 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6bb87011-cad3-457a-8275-4852db7fda63 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:46.021451 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6bb87011-cad3-457a-8275-4852db7fda63 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:46.022234 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6bb87011-cad3-457a-8275-4852db7fda63 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:46.022787 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6bb87011-cad3-457a-8275-4852db7fda63 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:46.050833 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-967a72d1-9609-4b49-b62b-89949eebe55f tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:46.051586 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-967a72d1-9609-4b49-b62b-89949eebe55f tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:46.059735 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-967a72d1-9609-4b49-b62b-89949eebe55f tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:46.060397 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-967a72d1-9609-4b49-b62b-89949eebe55f tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:46.061371 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-967a72d1-9609-4b49-b62b-89949eebe55f tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:46.061865 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-967a72d1-9609-4b49-b62b-89949eebe55f tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:46.226436 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-6bb87011-cad3-457a-8275-4852db7fda63 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:46.235332 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6bb87011-cad3-457a-8275-4852db7fda63 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1259 microversion: 2.1 time: 0.226528 Dec 14 10:11:46.235962 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 245/501] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:46 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:46.242574 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-14556df9-815d-4137-b5ca-c196c1fe67f8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:46.243179 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-14556df9-815d-4137-b5ca-c196c1fe67f8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:46.250604 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-14556df9-815d-4137-b5ca-c196c1fe67f8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:46.251052 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-14556df9-815d-4137-b5ca-c196c1fe67f8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:46.251948 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-14556df9-815d-4137-b5ca-c196c1fe67f8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:46.252537 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-14556df9-815d-4137-b5ca-c196c1fe67f8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:46.263546 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-967a72d1-9609-4b49-b62b-89949eebe55f tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:46.271683 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-967a72d1-9609-4b49-b62b-89949eebe55f tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1358 microversion: 2.1 time: 0.224680 Dec 14 10:11:46.272257 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 257/502] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:46 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:46.449812 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-aba2dea7-7b84-43aa-98f7-f4732c6b0a21 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:46.450439 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-aba2dea7-7b84-43aa-98f7-f4732c6b0a21 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:46.454658 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-14556df9-815d-4137-b5ca-c196c1fe67f8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:46.458015 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aba2dea7-7b84-43aa-98f7-f4732c6b0a21 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:46.458461 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aba2dea7-7b84-43aa-98f7-f4732c6b0a21 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:46.459223 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aba2dea7-7b84-43aa-98f7-f4732c6b0a21 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:46.459645 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aba2dea7-7b84-43aa-98f7-f4732c6b0a21 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:46.463618 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-14556df9-815d-4137-b5ca-c196c1fe67f8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.224407 Dec 14 10:11:46.464191 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 246/503] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:46 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:46.607300 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a603faf2-8bc4-4e9a-8d96-30f5b802148b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:46.607907 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a603faf2-8bc4-4e9a-8d96-30f5b802148b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:46.615236 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a603faf2-8bc4-4e9a-8d96-30f5b802148b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:46.615675 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a603faf2-8bc4-4e9a-8d96-30f5b802148b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:46.616431 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a603faf2-8bc4-4e9a-8d96-30f5b802148b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:46.616855 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a603faf2-8bc4-4e9a-8d96-30f5b802148b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:46.656552 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-aba2dea7-7b84-43aa-98f7-f4732c6b0a21 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:46.664501 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-aba2dea7-7b84-43aa-98f7-f4732c6b0a21 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1314 microversion: 2.1 time: 0.218398 Dec 14 10:11:46.665060 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 258/504] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:46 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:46.744468 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-a603faf2-8bc4-4e9a-8d96-30f5b802148b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:46.752620 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a603faf2-8bc4-4e9a-8d96-30f5b802148b tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 200 len: 1471 microversion: 2.1 time: 0.149043 Dec 14 10:11:46.753176 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 247/505] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:46 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:47.013673 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e8654761-8467-4fd1-9ce0-137f1c6d17b3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:47.014366 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e8654761-8467-4fd1-9ce0-137f1c6d17b3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:47.021549 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e8654761-8467-4fd1-9ce0-137f1c6d17b3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:47.022015 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e8654761-8467-4fd1-9ce0-137f1c6d17b3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:47.022781 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e8654761-8467-4fd1-9ce0-137f1c6d17b3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:47.023213 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e8654761-8467-4fd1-9ce0-137f1c6d17b3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:47.215046 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e8654761-8467-4fd1-9ce0-137f1c6d17b3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:47.223621 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e8654761-8467-4fd1-9ce0-137f1c6d17b3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1711 microversion: 2.1 time: 0.214391 Dec 14 10:11:47.224190 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 259/506] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:47 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1711 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:47.252429 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a4a1c454-221c-4fc8-8472-6428175a84b4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:47.253069 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a4a1c454-221c-4fc8-8472-6428175a84b4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:47.260179 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a4a1c454-221c-4fc8-8472-6428175a84b4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:47.260630 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a4a1c454-221c-4fc8-8472-6428175a84b4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:47.261394 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a4a1c454-221c-4fc8-8472-6428175a84b4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:47.262405 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a4a1c454-221c-4fc8-8472-6428175a84b4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:47.288311 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-be95f1bf-e49c-49d4-af87-f7adc74a912c tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:47.288866 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-be95f1bf-e49c-49d4-af87-f7adc74a912c tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:47.296584 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-be95f1bf-e49c-49d4-af87-f7adc74a912c tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:47.297024 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-be95f1bf-e49c-49d4-af87-f7adc74a912c tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:47.297778 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-be95f1bf-e49c-49d4-af87-f7adc74a912c tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:47.298238 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-be95f1bf-e49c-49d4-af87-f7adc74a912c tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:47.464567 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-a4a1c454-221c-4fc8-8472-6428175a84b4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:47.476403 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a4a1c454-221c-4fc8-8472-6428175a84b4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1259 microversion: 2.1 time: 0.227505 Dec 14 10:11:47.478344 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 248/507] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:47 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:47.482680 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6b275d5a-5d7f-4ba0-8c01-1f6714134a9c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:47.483287 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6b275d5a-5d7f-4ba0-8c01-1f6714134a9c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:47.504320 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6b275d5a-5d7f-4ba0-8c01-1f6714134a9c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:47.504710 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6b275d5a-5d7f-4ba0-8c01-1f6714134a9c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:47.505632 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6b275d5a-5d7f-4ba0-8c01-1f6714134a9c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:47.506106 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6b275d5a-5d7f-4ba0-8c01-1f6714134a9c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:47.510926 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-be95f1bf-e49c-49d4-af87-f7adc74a912c tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:47.519742 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-be95f1bf-e49c-49d4-af87-f7adc74a912c tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1358 microversion: 2.1 time: 0.235082 Dec 14 10:11:47.529835 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 260/508] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:47 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:47.682534 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4ec9792e-9c38-435e-85a6-80174014882c tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:47.683148 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4ec9792e-9c38-435e-85a6-80174014882c tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:47.691933 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4ec9792e-9c38-435e-85a6-80174014882c tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:47.691933 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4ec9792e-9c38-435e-85a6-80174014882c tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:47.692710 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4ec9792e-9c38-435e-85a6-80174014882c tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:47.693144 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4ec9792e-9c38-435e-85a6-80174014882c tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:47.721618 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-6b275d5a-5d7f-4ba0-8c01-1f6714134a9c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:47.735001 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6b275d5a-5d7f-4ba0-8c01-1f6714134a9c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.256547 Dec 14 10:11:47.735745 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 249/509] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:47 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:47.770622 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-7d7351ed-504e-4f74-b70d-06a1fc1caf63 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:47.771522 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-7d7351ed-504e-4f74-b70d-06a1fc1caf63 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:47.784562 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7d7351ed-504e-4f74-b70d-06a1fc1caf63 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:47.785761 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7d7351ed-504e-4f74-b70d-06a1fc1caf63 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:47.790740 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7d7351ed-504e-4f74-b70d-06a1fc1caf63 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:47.791181 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7d7351ed-504e-4f74-b70d-06a1fc1caf63 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:48.003153 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4ec9792e-9c38-435e-85a6-80174014882c tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:48.017211 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4ec9792e-9c38-435e-85a6-80174014882c tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1314 microversion: 2.1 time: 0.335957 Dec 14 10:11:48.018553 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 261/510] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:47 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:48.032921 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7d7351ed-504e-4f74-b70d-06a1fc1caf63 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:48.033365 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7d7351ed-504e-4f74-b70d-06a1fc1caf63 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:48.034346 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.objects.instance [None req-7d7351ed-504e-4f74-b70d-06a1fc1caf63 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lazy-loading 'fault' on Instance uuid b2cb221d-d3cd-4592-8e0b-479868639222 {{(pid=100985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:11:48.097067 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-7d7351ed-504e-4f74-b70d-06a1fc1caf63 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:48.106905 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-7d7351ed-504e-4f74-b70d-06a1fc1caf63 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 200 len: 1307 microversion: 2.1 time: 0.340300 Dec 14 10:11:48.107500 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 250/511] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:47 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 1307 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:48.240246 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-582c7dbb-41f6-49cb-b8fd-ef96bf2b3775 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:48.240843 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-582c7dbb-41f6-49cb-b8fd-ef96bf2b3775 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:48.248894 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-582c7dbb-41f6-49cb-b8fd-ef96bf2b3775 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:48.249338 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-582c7dbb-41f6-49cb-b8fd-ef96bf2b3775 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:48.250112 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-582c7dbb-41f6-49cb-b8fd-ef96bf2b3775 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:48.250537 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-582c7dbb-41f6-49cb-b8fd-ef96bf2b3775 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:48.452283 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-582c7dbb-41f6-49cb-b8fd-ef96bf2b3775 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:48.460812 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-582c7dbb-41f6-49cb-b8fd-ef96bf2b3775 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1715 microversion: 2.1 time: 0.224215 Dec 14 10:11:48.461364 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 262/512] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:48 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1715 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:48.494948 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e718e064-20f7-4dc1-bf1a-023aa3b0a14c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:48.495552 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e718e064-20f7-4dc1-bf1a-023aa3b0a14c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:48.502812 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e718e064-20f7-4dc1-bf1a-023aa3b0a14c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:48.503255 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e718e064-20f7-4dc1-bf1a-023aa3b0a14c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:48.504013 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e718e064-20f7-4dc1-bf1a-023aa3b0a14c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:48.504447 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e718e064-20f7-4dc1-bf1a-023aa3b0a14c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:48.537326 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-cf1324cf-e230-4cc3-98c0-791d181c6d33 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:48.538073 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-cf1324cf-e230-4cc3-98c0-791d181c6d33 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:48.546116 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cf1324cf-e230-4cc3-98c0-791d181c6d33 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:48.546690 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cf1324cf-e230-4cc3-98c0-791d181c6d33 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:48.547564 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cf1324cf-e230-4cc3-98c0-791d181c6d33 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:48.548086 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cf1324cf-e230-4cc3-98c0-791d181c6d33 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:48.714325 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-e718e064-20f7-4dc1-bf1a-023aa3b0a14c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:48.730180 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e718e064-20f7-4dc1-bf1a-023aa3b0a14c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1259 microversion: 2.1 time: 0.238670 Dec 14 10:11:48.731444 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 251/513] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:48 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:48.751893 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-2b6b807c-e36c-470d-80ad-7f4e512f35c2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:48.752808 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-2b6b807c-e36c-470d-80ad-7f4e512f35c2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:48.760205 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2b6b807c-e36c-470d-80ad-7f4e512f35c2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:48.760889 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2b6b807c-e36c-470d-80ad-7f4e512f35c2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:48.762460 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2b6b807c-e36c-470d-80ad-7f4e512f35c2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:48.762900 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2b6b807c-e36c-470d-80ad-7f4e512f35c2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:48.774520 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-cf1324cf-e230-4cc3-98c0-791d181c6d33 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:48.783812 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-cf1324cf-e230-4cc3-98c0-791d181c6d33 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1358 microversion: 2.1 time: 0.251083 Dec 14 10:11:48.784947 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 263/514] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:48 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:48.986934 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-2b6b807c-e36c-470d-80ad-7f4e512f35c2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:48.997040 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-2b6b807c-e36c-470d-80ad-7f4e512f35c2 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.247916 Dec 14 10:11:48.997546 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 252/515] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:48 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:49.034236 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1f28b4b9-53a4-4824-8325-2f216e07429f tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:49.034974 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1f28b4b9-53a4-4824-8325-2f216e07429f tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:49.042226 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1f28b4b9-53a4-4824-8325-2f216e07429f tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:49.042745 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1f28b4b9-53a4-4824-8325-2f216e07429f tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:49.044179 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1f28b4b9-53a4-4824-8325-2f216e07429f tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:49.044679 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1f28b4b9-53a4-4824-8325-2f216e07429f tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:49.124577 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-00836ba9-7af7-47f7-803b-def74ef23eed tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:49.125186 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-00836ba9-7af7-47f7-803b-def74ef23eed tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: b2cb221d-d3cd-4592-8e0b-479868639222] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:49.132545 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-00836ba9-7af7-47f7-803b-def74ef23eed tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:49.132997 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-00836ba9-7af7-47f7-803b-def74ef23eed tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:49.133764 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-00836ba9-7af7-47f7-803b-def74ef23eed tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:49.134227 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-00836ba9-7af7-47f7-803b-def74ef23eed tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:49.186157 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-00836ba9-7af7-47f7-803b-def74ef23eed tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] HTTP exception thrown: Instance b2cb221d-d3cd-4592-8e0b-479868639222 could not be found. Dec 14 10:11:49.186846 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-00836ba9-7af7-47f7-803b-def74ef23eed tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Returning 404 to user: Instance b2cb221d-d3cd-4592-8e0b-479868639222 could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:11:49.187712 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-00836ba9-7af7-47f7-803b-def74ef23eed tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222" status: 404 len: 111 microversion: 2.1 time: 0.067671 Dec 14 10:11:49.188339 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 253/516] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:49 2021] GET /compute/v2.1/servers/b2cb221d-d3cd-4592-8e0b-479868639222 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 14 10:11:49.262717 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1f28b4b9-53a4-4824-8325-2f216e07429f tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:49.271242 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1f28b4b9-53a4-4824-8325-2f216e07429f tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1314 microversion: 2.1 time: 0.240583 Dec 14 10:11:49.271861 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 264/517] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:49 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:49.747063 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3728ebf6-c68f-4f61-b976-59da6fa792a9 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:49.747667 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3728ebf6-c68f-4f61-b976-59da6fa792a9 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:49.754697 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3728ebf6-c68f-4f61-b976-59da6fa792a9 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:49.755143 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3728ebf6-c68f-4f61-b976-59da6fa792a9 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:49.755903 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3728ebf6-c68f-4f61-b976-59da6fa792a9 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:49.756331 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3728ebf6-c68f-4f61-b976-59da6fa792a9 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:49.802799 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d085d43a-948a-4d30-94f2-bd992b60dd70 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:49.803621 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d085d43a-948a-4d30-94f2-bd992b60dd70 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:49.811483 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d085d43a-948a-4d30-94f2-bd992b60dd70 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:49.812043 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d085d43a-948a-4d30-94f2-bd992b60dd70 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:49.812918 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d085d43a-948a-4d30-94f2-bd992b60dd70 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:49.813494 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d085d43a-948a-4d30-94f2-bd992b60dd70 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:49.961597 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3728ebf6-c68f-4f61-b976-59da6fa792a9 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:49.971393 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3728ebf6-c68f-4f61-b976-59da6fa792a9 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1259 microversion: 2.1 time: 0.227891 Dec 14 10:11:49.980555 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 254/518] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:49 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:49.980555 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-a94ed2a4-4b97-4d5e-a410-2eab204f9c30 req-18e95a55-061d-48fd-b9d5-e64105ddc673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a09e3d56-a48c-4117-bd3f-6cecf8857a25", "name": "network-vif-plugged", "status": "completed", "tag": "8700a3d2-b567-4851-a02f-46bf22ce6c5b"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:49.980555 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:11:49.980555 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:11:49.986530 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-a94ed2a4-4b97-4d5e-a410-2eab204f9c30 req-18e95a55-061d-48fd-b9d5-e64105ddc673 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:49.986980 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-a94ed2a4-4b97-4d5e-a410-2eab204f9c30 req-18e95a55-061d-48fd-b9d5-e64105ddc673 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:50.003838 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-a94ed2a4-4b97-4d5e-a410-2eab204f9c30 req-18e95a55-061d-48fd-b9d5-e64105ddc673 service nova] Creating event network-vif-plugged:8700a3d2-b567-4851-a02f-46bf22ce6c5b for instance a09e3d56-a48c-4117-bd3f-6cecf8857a25 on hv-cinder-81888 Dec 14 10:11:50.008476 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-a94ed2a4-4b97-4d5e-a410-2eab204f9c30 req-18e95a55-061d-48fd-b9d5-e64105ddc673 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035046 Dec 14 10:11:50.009341 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 255/519] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:11:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:11:50.015008 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6cfd5264-221f-4b21-b4dc-b3059456605d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:50.015720 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6cfd5264-221f-4b21-b4dc-b3059456605d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:50.030565 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6cfd5264-221f-4b21-b4dc-b3059456605d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:50.031018 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6cfd5264-221f-4b21-b4dc-b3059456605d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:50.032941 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6cfd5264-221f-4b21-b4dc-b3059456605d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:50.032941 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6cfd5264-221f-4b21-b4dc-b3059456605d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:50.047990 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d085d43a-948a-4d30-94f2-bd992b60dd70 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:50.060028 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d085d43a-948a-4d30-94f2-bd992b60dd70 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1547 microversion: 2.1 time: 0.261363 Dec 14 10:11:50.072090 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 265/520] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:49 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1547 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:50.094275 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-17afa752-447b-4e59-8beb-50e90792b7d1 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:50.094883 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-17afa752-447b-4e59-8beb-50e90792b7d1 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:50.102218 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-17afa752-447b-4e59-8beb-50e90792b7d1 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:50.102664 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-17afa752-447b-4e59-8beb-50e90792b7d1 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:50.103428 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-17afa752-447b-4e59-8beb-50e90792b7d1 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:50.103852 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-17afa752-447b-4e59-8beb-50e90792b7d1 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:50.279134 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-6cfd5264-221f-4b21-b4dc-b3059456605d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:50.289633 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6cfd5264-221f-4b21-b4dc-b3059456605d tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.279024 Dec 14 10:11:50.290754 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 256/521] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:50 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:50.297666 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e79f4797-51e5-4059-84fa-bb16d5057a88 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:50.298751 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e79f4797-51e5-4059-84fa-bb16d5057a88 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:50.307471 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e79f4797-51e5-4059-84fa-bb16d5057a88 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:50.308444 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e79f4797-51e5-4059-84fa-bb16d5057a88 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:50.310176 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e79f4797-51e5-4059-84fa-bb16d5057a88 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:50.311072 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e79f4797-51e5-4059-84fa-bb16d5057a88 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:50.548959 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-e79f4797-51e5-4059-84fa-bb16d5057a88 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:50.557513 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e79f4797-51e5-4059-84fa-bb16d5057a88 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1314 microversion: 2.1 time: 0.264867 Dec 14 10:11:50.558186 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 257/522] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:50 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:50.563877 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-ffeb2326-3a3a-4e1b-90ba-09953ba73657 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:50.564551 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-ffeb2326-3a3a-4e1b-90ba-09953ba73657 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:50.573373 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ffeb2326-3a3a-4e1b-90ba-09953ba73657 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:50.573817 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ffeb2326-3a3a-4e1b-90ba-09953ba73657 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:50.574880 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ffeb2326-3a3a-4e1b-90ba-09953ba73657 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:50.575265 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ffeb2326-3a3a-4e1b-90ba-09953ba73657 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:50.587534 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-17afa752-447b-4e59-8beb-50e90792b7d1 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:50.596561 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-17afa752-447b-4e59-8beb-50e90792b7d1 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1547 microversion: 2.1 time: 0.514314 Dec 14 10:11:50.597215 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 266/523] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:50 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1547 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:50.612335 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5de7742d-c6ee-4294-9fad-046e0976cb9d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:50.615699 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:11:50.615699 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:11:50.616677 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5de7742d-c6ee-4294-9fad-046e0976cb9d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:50.617455 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5de7742d-c6ee-4294-9fad-046e0976cb9d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Searching by: {'deleted': False, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a'} {{(pid=100984) get_all /opt/stack/nova/nova/compute/api.py:2855}} Dec 14 10:11:50.623504 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5de7742d-c6ee-4294-9fad-046e0976cb9d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:50.623938 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5de7742d-c6ee-4294-9fad-046e0976cb9d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:50.624722 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5de7742d-c6ee-4294-9fad-046e0976cb9d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:50.625147 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5de7742d-c6ee-4294-9fad-046e0976cb9d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:50.635808 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-ffeb2326-3a3a-4e1b-90ba-09953ba73657 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Going to try to terminate instance {{(pid=100985) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:11:50.714457 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.multi_cell_list [None req-5de7742d-c6ee-4294-9fad-046e0976cb9d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=100984) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Dec 14 10:11:50.748827 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-ffeb2326-3a3a-4e1b-90ba-09953ba73657 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 204 len: 0 microversion: 2.1 time: 0.187983 Dec 14 10:11:50.750243 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 258/524] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:11:50 2021] DELETE /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 10:11:50.758205 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-bce83cba-d6f6-413d-89a7-8c440dfc7601 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:50.758895 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-bce83cba-d6f6-413d-89a7-8c440dfc7601 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:50.765726 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bce83cba-d6f6-413d-89a7-8c440dfc7601 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:50.766272 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bce83cba-d6f6-413d-89a7-8c440dfc7601 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:50.767029 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bce83cba-d6f6-413d-89a7-8c440dfc7601 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:50.767454 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bce83cba-d6f6-413d-89a7-8c440dfc7601 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:50.808656 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5de7742d-c6ee-4294-9fad-046e0976cb9d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.199626 Dec 14 10:11:50.809231 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 267/525] 10.222.0.20 () {58 vars in 1124 bytes} [Tue Dec 14 10:11:50 2021] GET /compute/v2.1/servers => generated 342 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:11:50.818808 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8bc31162-70ca-4aed-a15b-807eeedd4732 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:50.819335 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-8bc31162-70ca-4aed-a15b-807eeedd4732 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:50.826445 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8bc31162-70ca-4aed-a15b-807eeedd4732 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:50.826885 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8bc31162-70ca-4aed-a15b-807eeedd4732 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:50.827640 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8bc31162-70ca-4aed-a15b-807eeedd4732 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:50.828061 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8bc31162-70ca-4aed-a15b-807eeedd4732 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:50.962031 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-bce83cba-d6f6-413d-89a7-8c440dfc7601 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:50.970231 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-bce83cba-d6f6-413d-89a7-8c440dfc7601 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1513 microversion: 2.1 time: 0.215779 Dec 14 10:11:50.970789 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 259/526] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:50 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:50.986810 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-396e2d14-e832-4f9a-af17-ab9fd87f382a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:50.987544 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-396e2d14-e832-4f9a-af17-ab9fd87f382a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:50.994891 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-396e2d14-e832-4f9a-af17-ab9fd87f382a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:50.996487 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-396e2d14-e832-4f9a-af17-ab9fd87f382a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:50.996855 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-396e2d14-e832-4f9a-af17-ab9fd87f382a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:50.997580 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-396e2d14-e832-4f9a-af17-ab9fd87f382a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:51.020965 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-8bc31162-70ca-4aed-a15b-807eeedd4732 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:51.030555 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8bc31162-70ca-4aed-a15b-807eeedd4732 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1547 microversion: 2.1 time: 0.215023 Dec 14 10:11:51.031253 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 268/527] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:50 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1547 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:51.282044 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-396e2d14-e832-4f9a-af17-ab9fd87f382a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:51.290005 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-396e2d14-e832-4f9a-af17-ab9fd87f382a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1259 microversion: 2.1 time: 0.306726 Dec 14 10:11:51.290575 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 260/528] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:50 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1259 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:51.306253 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-822179d8-183a-4f70-ad22-b27d8ae0c762 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:51.306852 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-822179d8-183a-4f70-ad22-b27d8ae0c762 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:51.314457 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-822179d8-183a-4f70-ad22-b27d8ae0c762 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:51.314892 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-822179d8-183a-4f70-ad22-b27d8ae0c762 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:51.315650 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-822179d8-183a-4f70-ad22-b27d8ae0c762 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:51.316072 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-822179d8-183a-4f70-ad22-b27d8ae0c762 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:51.525845 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-822179d8-183a-4f70-ad22-b27d8ae0c762 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:51.535168 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-822179d8-183a-4f70-ad22-b27d8ae0c762 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.232447 Dec 14 10:11:51.535730 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 269/529] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:51 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:51.575481 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-7eb186c1-c58d-4177-b2b6-2be0f216ad01 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:51.576093 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-7eb186c1-c58d-4177-b2b6-2be0f216ad01 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:51.583216 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7eb186c1-c58d-4177-b2b6-2be0f216ad01 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:51.583587 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7eb186c1-c58d-4177-b2b6-2be0f216ad01 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:51.584352 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7eb186c1-c58d-4177-b2b6-2be0f216ad01 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:51.584786 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7eb186c1-c58d-4177-b2b6-2be0f216ad01 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:51.775765 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-7eb186c1-c58d-4177-b2b6-2be0f216ad01 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:51.783980 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-7eb186c1-c58d-4177-b2b6-2be0f216ad01 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1314 microversion: 2.1 time: 0.212716 Dec 14 10:11:51.784535 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 261/530] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:51 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:51.987100 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-fecb146d-07d2-44a1-b69f-2b92f6f7b2fb tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:51.987832 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-fecb146d-07d2-44a1-b69f-2b92f6f7b2fb tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:51.995023 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fecb146d-07d2-44a1-b69f-2b92f6f7b2fb tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:51.995464 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fecb146d-07d2-44a1-b69f-2b92f6f7b2fb tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:51.996957 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fecb146d-07d2-44a1-b69f-2b92f6f7b2fb tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:51.997598 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fecb146d-07d2-44a1-b69f-2b92f6f7b2fb tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:52.195201 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-fecb146d-07d2-44a1-b69f-2b92f6f7b2fb tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:52.203405 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-fecb146d-07d2-44a1-b69f-2b92f6f7b2fb tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1513 microversion: 2.1 time: 0.219975 Dec 14 10:11:52.203956 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 270/531] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:51 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1513 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:52.307459 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6836a215-7b59-4153-9ef3-aa6ec1f91c9a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:52.307981 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6836a215-7b59-4153-9ef3-aa6ec1f91c9a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:52.315469 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6836a215-7b59-4153-9ef3-aa6ec1f91c9a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:52.315905 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6836a215-7b59-4153-9ef3-aa6ec1f91c9a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:52.316651 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6836a215-7b59-4153-9ef3-aa6ec1f91c9a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:52.317076 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6836a215-7b59-4153-9ef3-aa6ec1f91c9a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:52.512259 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-6836a215-7b59-4153-9ef3-aa6ec1f91c9a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:52.520262 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6836a215-7b59-4153-9ef3-aa6ec1f91c9a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1259 microversion: 2.1 time: 0.216704 Dec 14 10:11:52.520811 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 262/532] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:52 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:52.552430 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-cbfabf06-c5a6-4df9-8d70-232e5b9757bd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:52.553033 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-cbfabf06-c5a6-4df9-8d70-232e5b9757bd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:52.560300 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cbfabf06-c5a6-4df9-8d70-232e5b9757bd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:52.560679 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cbfabf06-c5a6-4df9-8d70-232e5b9757bd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:52.561460 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cbfabf06-c5a6-4df9-8d70-232e5b9757bd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:52.561882 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cbfabf06-c5a6-4df9-8d70-232e5b9757bd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:52.751265 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-cbfabf06-c5a6-4df9-8d70-232e5b9757bd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:52.759715 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-cbfabf06-c5a6-4df9-8d70-232e5b9757bd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.210916 Dec 14 10:11:52.760273 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 271/533] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:52 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:52.801282 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e012668f-98b4-4912-9817-6c3a5da2a93b tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:52.801885 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e012668f-98b4-4912-9817-6c3a5da2a93b tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:52.809350 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e012668f-98b4-4912-9817-6c3a5da2a93b tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:52.809799 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e012668f-98b4-4912-9817-6c3a5da2a93b tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:52.810641 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e012668f-98b4-4912-9817-6c3a5da2a93b tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:52.811024 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e012668f-98b4-4912-9817-6c3a5da2a93b tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:53.003982 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-e012668f-98b4-4912-9817-6c3a5da2a93b tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:53.012712 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e012668f-98b4-4912-9817-6c3a5da2a93b tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1314 microversion: 2.1 time: 0.214986 Dec 14 10:11:53.013282 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 263/534] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:52 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:53.219918 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8d467929-db76-4b0e-ae4d-41d57a3ce2f1 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:53.220527 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-8d467929-db76-4b0e-ae4d-41d57a3ce2f1 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:53.227749 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8d467929-db76-4b0e-ae4d-41d57a3ce2f1 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:53.228198 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8d467929-db76-4b0e-ae4d-41d57a3ce2f1 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:53.228955 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8d467929-db76-4b0e-ae4d-41d57a3ce2f1 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:53.229387 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8d467929-db76-4b0e-ae4d-41d57a3ce2f1 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:53.425985 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-8d467929-db76-4b0e-ae4d-41d57a3ce2f1 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:53.434167 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8d467929-db76-4b0e-ae4d-41d57a3ce2f1 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1513 microversion: 2.1 time: 0.217365 Dec 14 10:11:53.434733 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 272/535] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:53 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1513 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:53.537377 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-0a8d9e05-36ac-4d5f-a932-b4b99ba9b321 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:53.538091 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-0a8d9e05-36ac-4d5f-a932-b4b99ba9b321 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:53.546041 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0a8d9e05-36ac-4d5f-a932-b4b99ba9b321 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:53.546552 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0a8d9e05-36ac-4d5f-a932-b4b99ba9b321 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:53.547383 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0a8d9e05-36ac-4d5f-a932-b4b99ba9b321 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:53.547819 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0a8d9e05-36ac-4d5f-a932-b4b99ba9b321 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:53.746695 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-0a8d9e05-36ac-4d5f-a932-b4b99ba9b321 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:53.754676 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-0a8d9e05-36ac-4d5f-a932-b4b99ba9b321 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1259 microversion: 2.1 time: 0.221042 Dec 14 10:11:53.755224 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 264/536] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:53 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1259 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:53.777544 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1dc2fd4f-02bf-4b87-be51-78e843e1d35b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:53.778371 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1dc2fd4f-02bf-4b87-be51-78e843e1d35b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:53.785374 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1dc2fd4f-02bf-4b87-be51-78e843e1d35b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:53.785810 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1dc2fd4f-02bf-4b87-be51-78e843e1d35b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:53.786591 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1dc2fd4f-02bf-4b87-be51-78e843e1d35b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:53.787023 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1dc2fd4f-02bf-4b87-be51-78e843e1d35b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:53.977763 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1dc2fd4f-02bf-4b87-be51-78e843e1d35b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:53.986304 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1dc2fd4f-02bf-4b87-be51-78e843e1d35b tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.213098 Dec 14 10:11:53.986864 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 273/537] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:53 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:54.029913 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-fc2a0e83-5e60-4c77-b285-6ea88013b28a tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:54.030564 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-fc2a0e83-5e60-4c77-b285-6ea88013b28a tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:54.037794 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fc2a0e83-5e60-4c77-b285-6ea88013b28a tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:54.038278 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fc2a0e83-5e60-4c77-b285-6ea88013b28a tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:54.039051 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fc2a0e83-5e60-4c77-b285-6ea88013b28a tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:54.039486 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fc2a0e83-5e60-4c77-b285-6ea88013b28a tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:54.236423 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-fc2a0e83-5e60-4c77-b285-6ea88013b28a tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:54.251635 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-fc2a0e83-5e60-4c77-b285-6ea88013b28a tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1314 microversion: 2.1 time: 0.226049 Dec 14 10:11:54.252208 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 265/538] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:54 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:54.451013 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-3a7cebb6-6e76-4fa9-8756-81eeb651a17a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:54.451618 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-3a7cebb6-6e76-4fa9-8756-81eeb651a17a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:54.458903 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3a7cebb6-6e76-4fa9-8756-81eeb651a17a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:54.459343 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3a7cebb6-6e76-4fa9-8756-81eeb651a17a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:54.460096 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3a7cebb6-6e76-4fa9-8756-81eeb651a17a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:54.460521 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3a7cebb6-6e76-4fa9-8756-81eeb651a17a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:54.673334 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-3a7cebb6-6e76-4fa9-8756-81eeb651a17a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:54.682270 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-3a7cebb6-6e76-4fa9-8756-81eeb651a17a tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1513 microversion: 2.1 time: 0.235015 Dec 14 10:11:54.691490 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 274/539] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:54 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1513 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:54.701623 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3ab21ee6-78b7-41f1-8ffe-00034b4b40bc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-506051467", "imageRef": "5be36fdc-2baa-4efd-b830-5a5c3fd7beba", "flavorRef": "452", "networks": [{"uuid": "4613aaa2-a4df-463e-b247-3ca86ac39e26"}]}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:54.769866 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.network.neutron [None req-3ab21ee6-78b7-41f1-8ffe-00034b4b40bc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] validate_networks() for [('4613aaa2-a4df-463e-b247-3ca86ac39e26', None, None, None)] {{(pid=100985) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:11:54.771415 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-7df2f796-bcee-4a77-b61d-a0eda132a748 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:54.772029 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-7df2f796-bcee-4a77-b61d-a0eda132a748 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:54.780118 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7df2f796-bcee-4a77-b61d-a0eda132a748 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:54.781173 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7df2f796-bcee-4a77-b61d-a0eda132a748 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:54.781948 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7df2f796-bcee-4a77-b61d-a0eda132a748 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:54.782423 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7df2f796-bcee-4a77-b61d-a0eda132a748 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:54.980691 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-7df2f796-bcee-4a77-b61d-a0eda132a748 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:54.988833 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-7df2f796-bcee-4a77-b61d-a0eda132a748 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1259 microversion: 2.1 time: 0.221149 Dec 14 10:11:54.989398 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 275/540] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:54 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1259 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:54.996041 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c404c7a2-19ed-464e-861c-b2b6b2c1c899 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8256ab6f-1e4b-4975-905f-182c11b3d9c6"}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:54.997826 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c404c7a2-19ed-464e-861c-b2b6b2c1c899 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:55.005370 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c404c7a2-19ed-464e-861c-b2b6b2c1c899 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:55.005809 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c404c7a2-19ed-464e-861c-b2b6b2c1c899 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:55.006613 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c404c7a2-19ed-464e-861c-b2b6b2c1c899 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:55.007042 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c404c7a2-19ed-464e-861c-b2b6b2c1c899 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:55.315877 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-3ab21ee6-78b7-41f1-8ffe-00034b4b40bc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Flavor limits 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:11:55.316504 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-3ab21ee6-78b7-41f1-8ffe-00034b4b40bc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Image limits 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:11:55.316760 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-3ab21ee6-78b7-41f1-8ffe-00034b4b40bc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Flavor pref 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:11:55.317199 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-3ab21ee6-78b7-41f1-8ffe-00034b4b40bc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Image pref 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:11:55.317613 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-3ab21ee6-78b7-41f1-8ffe-00034b4b40bc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:11:55.333132 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3ab21ee6-78b7-41f1-8ffe-00034b4b40bc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:55.333581 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3ab21ee6-78b7-41f1-8ffe-00034b4b40bc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:55.334407 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3ab21ee6-78b7-41f1-8ffe-00034b4b40bc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:55.334853 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3ab21ee6-78b7-41f1-8ffe-00034b4b40bc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:55.359234 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-3ab21ee6-78b7-41f1-8ffe-00034b4b40bc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Getting quotas for project 2526870696444f07a95751c539846668. Resources: {'cores', 'instances', 'ram'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:11:55.363540 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-3ab21ee6-78b7-41f1-8ffe-00034b4b40bc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Getting quotas for user 1315f20a3c734bdebe2197a7cc4d9064 and project 2526870696444f07a95751c539846668. Resources: {'cores', 'instances', 'ram'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:11:55.375026 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3ab21ee6-78b7-41f1-8ffe-00034b4b40bc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Going to run 1 instances... {{(pid=100985) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:11:55.377580 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3ab21ee6-78b7-41f1-8ffe-00034b4b40bc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: 4f0deec7-37f0-4eb9-bfa5-85b697768ad6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5be36fdc-2baa-4efd-b830-5a5c3fd7beba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:11:55.383684 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c404c7a2-19ed-464e-861c-b2b6b2c1c899 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "POST /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.392122 Dec 14 10:11:55.384530 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 276/541] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Dec 14 10:11:54 2021] POST /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:11:55.395510 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a843ed62-a911-44ae-afd5-a4a7f4601e5f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:55.396460 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-a843ed62-a911-44ae-afd5-a4a7f4601e5f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:55.410081 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a843ed62-a911-44ae-afd5-a4a7f4601e5f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:55.410739 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a843ed62-a911-44ae-afd5-a4a7f4601e5f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:55.418855 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a843ed62-a911-44ae-afd5-a4a7f4601e5f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:55.419372 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a843ed62-a911-44ae-afd5-a4a7f4601e5f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:55.427525 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3ab21ee6-78b7-41f1-8ffe-00034b4b40bc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729985 Dec 14 10:11:55.428311 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 266/542] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Dec 14 10:11:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 10:11:55.433461 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e87ce1f6-c8ad-4833-97a6-944026ff5312 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:55.433909 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e87ce1f6-c8ad-4833-97a6-944026ff5312 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:55.441500 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e87ce1f6-c8ad-4833-97a6-944026ff5312 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:55.442072 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e87ce1f6-c8ad-4833-97a6-944026ff5312 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:55.442927 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e87ce1f6-c8ad-4833-97a6-944026ff5312 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:55.443529 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e87ce1f6-c8ad-4833-97a6-944026ff5312 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:55.704651 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-a843ed62-a911-44ae-afd5-a4a7f4601e5f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:55.715629 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a843ed62-a911-44ae-afd5-a4a7f4601e5f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.329566 Dec 14 10:11:55.725246 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 277/543] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:55 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:55.725246 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-026536d0-c1e9-4d19-9a3e-08d962a61af4 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:55.725246 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-026536d0-c1e9-4d19-9a3e-08d962a61af4 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: 4f0deec7-37f0-4eb9-bfa5-85b697768ad6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:55.811210 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-026536d0-c1e9-4d19-9a3e-08d962a61af4 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:55.820226 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-026536d0-c1e9-4d19-9a3e-08d962a61af4 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6" status: 200 len: 1218 microversion: 2.1 time: 0.102151 Dec 14 10:11:55.820940 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 278/544] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:55 2021] GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:55.826684 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5253892d-74ca-4fe4-934b-4bf97baa77ac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:55.827908 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5253892d-74ca-4fe4-934b-4bf97baa77ac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:55.836917 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5253892d-74ca-4fe4-934b-4bf97baa77ac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:55.837898 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5253892d-74ca-4fe4-934b-4bf97baa77ac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:55.838924 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5253892d-74ca-4fe4-934b-4bf97baa77ac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:55.840250 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5253892d-74ca-4fe4-934b-4bf97baa77ac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:55.895116 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-e87ce1f6-c8ad-4833-97a6-944026ff5312 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:55.907706 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e87ce1f6-c8ad-4833-97a6-944026ff5312 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1463 microversion: 2.1 time: 0.474969 Dec 14 10:11:55.909597 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 267/545] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:55 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1463 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:55.916405 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-b838e51e-b7a5-4e57-84d9-bcf920d3d1df req-402170e0-257f-4397-9f7c-196ef807de68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731c99da-4633-4de9-9678-02e9fecda7b4", "name": "network-vif-plugged", "status": "completed", "tag": "eb309f74-48d9-4eb5-98e8-7571414fa330"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:55.920595 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:11:55.920595 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:11:55.958067 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-b838e51e-b7a5-4e57-84d9-bcf920d3d1df req-402170e0-257f-4397-9f7c-196ef807de68 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:55.958638 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-b838e51e-b7a5-4e57-84d9-bcf920d3d1df req-402170e0-257f-4397-9f7c-196ef807de68 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:55.977916 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-b838e51e-b7a5-4e57-84d9-bcf920d3d1df req-402170e0-257f-4397-9f7c-196ef807de68 service nova] Creating event network-vif-plugged:eb309f74-48d9-4eb5-98e8-7571414fa330 for instance 731c99da-4633-4de9-9678-02e9fecda7b4 on hv-cinder-81888 Dec 14 10:11:55.982919 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-b838e51e-b7a5-4e57-84d9-bcf920d3d1df req-402170e0-257f-4397-9f7c-196ef807de68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072115 Dec 14 10:11:55.983592 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 268/546] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:11:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:11:56.008378 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-0d6fca21-500b-4d0a-9bf7-db7e243cc8f4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:56.009449 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-0d6fca21-500b-4d0a-9bf7-db7e243cc8f4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:56.023233 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0d6fca21-500b-4d0a-9bf7-db7e243cc8f4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:56.026550 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0d6fca21-500b-4d0a-9bf7-db7e243cc8f4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:56.028429 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0d6fca21-500b-4d0a-9bf7-db7e243cc8f4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:56.030685 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0d6fca21-500b-4d0a-9bf7-db7e243cc8f4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:56.132369 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5253892d-74ca-4fe4-934b-4bf97baa77ac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:56.143648 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5253892d-74ca-4fe4-934b-4bf97baa77ac tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1513 microversion: 2.1 time: 0.321473 Dec 14 10:11:56.153838 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 279/547] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:55 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1513 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:56.153838 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c122cbca-c299-4975-8821-f510c307e744 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:56.153838 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c122cbca-c299-4975-8821-f510c307e744 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:56.158670 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c122cbca-c299-4975-8821-f510c307e744 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:56.159312 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c122cbca-c299-4975-8821-f510c307e744 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:56.160407 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c122cbca-c299-4975-8821-f510c307e744 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:56.161082 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c122cbca-c299-4975-8821-f510c307e744 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:56.232671 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c122cbca-c299-4975-8821-f510c307e744 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Going to try to terminate instance {{(pid=100984) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:11:56.515381 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c122cbca-c299-4975-8821-f510c307e744 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 204 len: 0 microversion: 2.1 time: 0.369733 Dec 14 10:11:56.516555 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 280/548] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:11:56 2021] DELETE /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 10:11:56.525499 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-2c9727b2-1880-42eb-94ee-bdc1cbeb10fb tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:56.526460 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-2c9727b2-1880-42eb-94ee-bdc1cbeb10fb tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:56.533924 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2c9727b2-1880-42eb-94ee-bdc1cbeb10fb tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:56.534494 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2c9727b2-1880-42eb-94ee-bdc1cbeb10fb tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:56.535254 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2c9727b2-1880-42eb-94ee-bdc1cbeb10fb tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:56.535796 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2c9727b2-1880-42eb-94ee-bdc1cbeb10fb tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:56.651945 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-0d6fca21-500b-4d0a-9bf7-db7e243cc8f4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:56.661783 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-0d6fca21-500b-4d0a-9bf7-db7e243cc8f4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1259 microversion: 2.1 time: 0.658059 Dec 14 10:11:56.662381 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 269/549] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:56 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1259 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:56.732797 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c419dbae-c8be-46ec-a0f5-ba5517923b70 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:56.733406 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c419dbae-c8be-46ec-a0f5-ba5517923b70 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:56.740721 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c419dbae-c8be-46ec-a0f5-ba5517923b70 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:56.741405 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c419dbae-c8be-46ec-a0f5-ba5517923b70 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:56.742378 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c419dbae-c8be-46ec-a0f5-ba5517923b70 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:56.743259 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c419dbae-c8be-46ec-a0f5-ba5517923b70 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:56.764132 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-2c9727b2-1880-42eb-94ee-bdc1cbeb10fb tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:56.784206 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-2c9727b2-1880-42eb-94ee-bdc1cbeb10fb tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1469 microversion: 2.1 time: 0.261965 Dec 14 10:11:56.784206 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 281/550] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:56 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1469 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:56.838170 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8fc72cde-d69f-40f4-96c7-0970e066868a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:56.839550 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-8fc72cde-d69f-40f4-96c7-0970e066868a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: 4f0deec7-37f0-4eb9-bfa5-85b697768ad6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:56.848085 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8fc72cde-d69f-40f4-96c7-0970e066868a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:56.848613 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8fc72cde-d69f-40f4-96c7-0970e066868a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:56.849450 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8fc72cde-d69f-40f4-96c7-0970e066868a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:56.849942 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8fc72cde-d69f-40f4-96c7-0970e066868a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:56.983457 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-8fc72cde-d69f-40f4-96c7-0970e066868a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:56.995549 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8fc72cde-d69f-40f4-96c7-0970e066868a tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6" status: 200 len: 1270 microversion: 2.1 time: 0.161263 Dec 14 10:11:56.999025 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 282/551] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:56 2021] GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6 => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:57.012434 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-4e51ac87-ee1a-4b99-8c30-9f260bdf1bc1 req-e882d8f4-42ee-4a61-adf0-4e7492c99642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e60e3bf-4317-4c75-87fd-d9dd68489214", "name": "network-vif-deleted", "tag": "385495e2-0211-4c85-9b90-9b279f481c48"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:57.017833 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:11:57.017833 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:11:57.030582 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-4e51ac87-ee1a-4b99-8c30-9f260bdf1bc1 req-e882d8f4-42ee-4a61-adf0-4e7492c99642 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:57.031942 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-4e51ac87-ee1a-4b99-8c30-9f260bdf1bc1 req-e882d8f4-42ee-4a61-adf0-4e7492c99642 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:57.055982 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-4e51ac87-ee1a-4b99-8c30-9f260bdf1bc1 req-e882d8f4-42ee-4a61-adf0-4e7492c99642 service nova] Creating event network-vif-deleted:385495e2-0211-4c85-9b90-9b279f481c48 for instance 9e60e3bf-4317-4c75-87fd-d9dd68489214 on hv-cinder-81888 Dec 14 10:11:57.069725 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-4e51ac87-ee1a-4b99-8c30-9f260bdf1bc1 req-e882d8f4-42ee-4a61-adf0-4e7492c99642 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069037 Dec 14 10:11:57.070307 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 283/552] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:11:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:11:57.105610 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-c419dbae-c8be-46ec-a0f5-ba5517923b70 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:57.114933 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c419dbae-c8be-46ec-a0f5-ba5517923b70 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1567 microversion: 2.1 time: 0.385942 Dec 14 10:11:57.115513 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 270/553] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:56 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1567 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:57.163605 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a8bcce3a-2f1b-4065-93e5-4bbff396f17e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:57.164390 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-a8bcce3a-2f1b-4065-93e5-4bbff396f17e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:57.172458 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a8bcce3a-2f1b-4065-93e5-4bbff396f17e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:57.172912 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a8bcce3a-2f1b-4065-93e5-4bbff396f17e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:57.173673 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a8bcce3a-2f1b-4065-93e5-4bbff396f17e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:57.174132 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a8bcce3a-2f1b-4065-93e5-4bbff396f17e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:57.289579 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-a8bcce3a-2f1b-4065-93e5-4bbff396f17e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:57.300134 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a8bcce3a-2f1b-4065-93e5-4bbff396f17e tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 200 len: 1303 microversion: 2.1 time: 0.142951 Dec 14 10:11:57.300744 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 284/554] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:57 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 1303 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:57.678601 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e2a103d2-0e26-4663-9461-db1b33f5f391 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:57.679212 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e2a103d2-0e26-4663-9461-db1b33f5f391 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:57.690382 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e2a103d2-0e26-4663-9461-db1b33f5f391 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:57.690820 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e2a103d2-0e26-4663-9461-db1b33f5f391 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:57.691593 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e2a103d2-0e26-4663-9461-db1b33f5f391 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:57.692024 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e2a103d2-0e26-4663-9461-db1b33f5f391 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:57.799969 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-b9e35c85-398f-42c7-a0c5-7609eb7423a4 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:57.800678 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-b9e35c85-398f-42c7-a0c5-7609eb7423a4 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:57.807885 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b9e35c85-398f-42c7-a0c5-7609eb7423a4 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:57.809394 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b9e35c85-398f-42c7-a0c5-7609eb7423a4 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:57.809869 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b9e35c85-398f-42c7-a0c5-7609eb7423a4 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:57.810395 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b9e35c85-398f-42c7-a0c5-7609eb7423a4 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:58.034965 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-b9e35c85-398f-42c7-a0c5-7609eb7423a4 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:58.045426 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-e2a103d2-0e26-4663-9461-db1b33f5f391 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:58.046914 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-b9e35c85-398f-42c7-a0c5-7609eb7423a4 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1469 microversion: 2.1 time: 0.250325 Dec 14 10:11:58.054651 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e2a103d2-0e26-4663-9461-db1b33f5f391 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1259 microversion: 2.1 time: 0.379680 Dec 14 10:11:58.057522 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 285/555] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:57 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1469 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:58.065624 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 271/556] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:57 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1259 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:58.070966 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8036e309-683b-4efb-9c45-2df479534cfe tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:58.072485 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-8036e309-683b-4efb-9c45-2df479534cfe tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: 4f0deec7-37f0-4eb9-bfa5-85b697768ad6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:58.080438 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8036e309-683b-4efb-9c45-2df479534cfe tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:58.080886 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8036e309-683b-4efb-9c45-2df479534cfe tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:58.081677 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8036e309-683b-4efb-9c45-2df479534cfe tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:58.082152 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8036e309-683b-4efb-9c45-2df479534cfe tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:58.132515 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-1f6f537c-bf66-4e01-896a-25f35e55ab5e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:58.133123 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-1f6f537c-bf66-4e01-896a-25f35e55ab5e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:58.142709 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1f6f537c-bf66-4e01-896a-25f35e55ab5e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:58.142709 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1f6f537c-bf66-4e01-896a-25f35e55ab5e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:58.143425 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1f6f537c-bf66-4e01-896a-25f35e55ab5e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:58.143869 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1f6f537c-bf66-4e01-896a-25f35e55ab5e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:58.330102 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-8036e309-683b-4efb-9c45-2df479534cfe tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:58.338887 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8036e309-683b-4efb-9c45-2df479534cfe tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6" status: 200 len: 1318 microversion: 2.1 time: 0.280029 Dec 14 10:11:58.339689 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 286/557] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:58 2021] GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:58.343765 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-3b445392-ab38-4082-81d5-296b5aaadcc6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:58.344360 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-3b445392-ab38-4082-81d5-296b5aaadcc6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 9e60e3bf-4317-4c75-87fd-d9dd68489214] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:58.351418 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3b445392-ab38-4082-81d5-296b5aaadcc6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:58.351841 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3b445392-ab38-4082-81d5-296b5aaadcc6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:58.352597 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3b445392-ab38-4082-81d5-296b5aaadcc6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:58.353021 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3b445392-ab38-4082-81d5-296b5aaadcc6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:58.402968 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-3b445392-ab38-4082-81d5-296b5aaadcc6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] HTTP exception thrown: Instance 9e60e3bf-4317-4c75-87fd-d9dd68489214 could not be found. Dec 14 10:11:58.403473 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-3b445392-ab38-4082-81d5-296b5aaadcc6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Returning 404 to user: Instance 9e60e3bf-4317-4c75-87fd-d9dd68489214 could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:11:58.404287 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-3b445392-ab38-4082-81d5-296b5aaadcc6 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214" status: 404 len: 111 microversion: 2.1 time: 0.063914 Dec 14 10:11:58.404831 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 287/558] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:58 2021] GET /compute/v2.1/servers/9e60e3bf-4317-4c75-87fd-d9dd68489214 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:11:58.412164 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-9c593963-c789-46eb-bd6e-0a5cdd9b34d0 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:58.412647 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-9c593963-c789-46eb-bd6e-0a5cdd9b34d0 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:58.419819 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9c593963-c789-46eb-bd6e-0a5cdd9b34d0 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:58.420273 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9c593963-c789-46eb-bd6e-0a5cdd9b34d0 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:58.421006 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9c593963-c789-46eb-bd6e-0a5cdd9b34d0 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:58.421427 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9c593963-c789-46eb-bd6e-0a5cdd9b34d0 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:58.481920 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-9c593963-c789-46eb-bd6e-0a5cdd9b34d0 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Going to try to terminate instance {{(pid=100984) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:11:58.513704 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-1f6f537c-bf66-4e01-896a-25f35e55ab5e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:58.522645 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-1f6f537c-bf66-4e01-896a-25f35e55ab5e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1547 microversion: 2.1 time: 0.393852 Dec 14 10:11:58.523369 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 272/559] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:58 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1547 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:58.540036 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6566c19b-c420-4516-8974-3c6f9f2d4e1f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:58.540673 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6566c19b-c420-4516-8974-3c6f9f2d4e1f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:58.548964 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6566c19b-c420-4516-8974-3c6f9f2d4e1f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:58.549669 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6566c19b-c420-4516-8974-3c6f9f2d4e1f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:58.550473 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6566c19b-c420-4516-8974-3c6f9f2d4e1f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:58.550907 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6566c19b-c420-4516-8974-3c6f9f2d4e1f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:58.599838 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-9c593963-c789-46eb-bd6e-0a5cdd9b34d0 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e" status: 204 len: 0 microversion: 2.1 time: 0.190717 Dec 14 10:11:58.600697 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 288/560] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:11:58 2021] DELETE /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 14 10:11:58.609786 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-950b9c2e-9b4f-4993-bd33-54d3985b5f9d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:58.610528 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-950b9c2e-9b4f-4993-bd33-54d3985b5f9d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:58.617656 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-950b9c2e-9b4f-4993-bd33-54d3985b5f9d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:58.618149 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-950b9c2e-9b4f-4993-bd33-54d3985b5f9d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:58.618922 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-950b9c2e-9b4f-4993-bd33-54d3985b5f9d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:58.619353 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-950b9c2e-9b4f-4993-bd33-54d3985b5f9d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:58.739800 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-6566c19b-c420-4516-8974-3c6f9f2d4e1f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] HTTP exception thrown: Cannot 'detach_volume' instance 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd while it is in vm_state rescued Dec 14 10:11:58.742447 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6566c19b-c420-4516-8974-3c6f9f2d4e1f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Returning 409 to user: Cannot 'detach_volume' instance 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd while it is in vm_state rescued {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:11:58.743627 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6566c19b-c420-4516-8974-3c6f9f2d4e1f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/os-volume_attachments/f71d54b6-0d2a-4075-90fe-81d02953deae" status: 409 len: 152 microversion: 2.1 time: 0.207482 Dec 14 10:11:58.746535 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 273/561] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Dec 14 10:11:58 2021] DELETE /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/os-volume_attachments/f71d54b6-0d2a-4075-90fe-81d02953deae => generated 152 bytes in 210 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 14 10:11:58.757595 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6e957bae-86b0-4964-b2f3-b931b6ea8a3f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:58.758207 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6e957bae-86b0-4964-b2f3-b931b6ea8a3f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:58.777599 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6e957bae-86b0-4964-b2f3-b931b6ea8a3f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:58.778077 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6e957bae-86b0-4964-b2f3-b931b6ea8a3f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:58.778861 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6e957bae-86b0-4964-b2f3-b931b6ea8a3f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:58.779298 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6e957bae-86b0-4964-b2f3-b931b6ea8a3f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:58.881077 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-950b9c2e-9b4f-4993-bd33-54d3985b5f9d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:58.890413 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-950b9c2e-9b4f-4993-bd33-54d3985b5f9d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e" status: 200 len: 1513 microversion: 2.1 time: 0.285578 Dec 14 10:11:58.890978 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 289/562] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:58 2021] GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e => generated 1513 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:58.918103 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6e957bae-86b0-4964-b2f3-b931b6ea8a3f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "POST /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/action" status: 202 len: 0 microversion: 2.1 time: 0.165607 Dec 14 10:11:58.921609 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 274/563] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:11:58 2021] POST /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:11:58.926619 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-99f90c66-46d3-4371-b2d6-f8b66eca5c79 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:58.927536 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-99f90c66-46d3-4371-b2d6-f8b66eca5c79 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:58.935962 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-99f90c66-46d3-4371-b2d6-f8b66eca5c79 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:58.936761 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-99f90c66-46d3-4371-b2d6-f8b66eca5c79 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:58.938097 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-99f90c66-46d3-4371-b2d6-f8b66eca5c79 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:58.938737 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-99f90c66-46d3-4371-b2d6-f8b66eca5c79 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:59.067161 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-22c95f10-d38a-440f-830e-3daecd4d01b1 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:59.068285 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-22c95f10-d38a-440f-830e-3daecd4d01b1 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:59.077115 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-22c95f10-d38a-440f-830e-3daecd4d01b1 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:59.077674 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-22c95f10-d38a-440f-830e-3daecd4d01b1 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:59.078551 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-22c95f10-d38a-440f-830e-3daecd4d01b1 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:59.079050 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-22c95f10-d38a-440f-830e-3daecd4d01b1 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:59.389822 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-99f90c66-46d3-4371-b2d6-f8b66eca5c79 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:59.399122 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-99f90c66-46d3-4371-b2d6-f8b66eca5c79 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1555 microversion: 2.1 time: 0.476179 Dec 14 10:11:59.400564 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 290/564] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:58 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1555 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:59.412632 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c7902c94-2b33-40b5-a2d6-367901cce1b9 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:59.413421 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c7902c94-2b33-40b5-a2d6-367901cce1b9 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:59.422168 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c7902c94-2b33-40b5-a2d6-367901cce1b9 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:59.422622 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c7902c94-2b33-40b5-a2d6-367901cce1b9 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:59.423436 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c7902c94-2b33-40b5-a2d6-367901cce1b9 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:59.423879 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c7902c94-2b33-40b5-a2d6-367901cce1b9 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:59.680256 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-22c95f10-d38a-440f-830e-3daecd4d01b1 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:59.689419 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-22c95f10-d38a-440f-830e-3daecd4d01b1 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1469 microversion: 2.1 time: 0.628454 Dec 14 10:11:59.700363 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 275/565] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:59 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1469 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:11:59.705484 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-7365dc54-71f0-4ae2-b63d-7922a41ca462 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:59.706559 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-7365dc54-71f0-4ae2-b63d-7922a41ca462 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: 4f0deec7-37f0-4eb9-bfa5-85b697768ad6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:59.714916 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7365dc54-71f0-4ae2-b63d-7922a41ca462 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:59.715328 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7365dc54-71f0-4ae2-b63d-7922a41ca462 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:59.716067 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7365dc54-71f0-4ae2-b63d-7922a41ca462 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:59.716660 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7365dc54-71f0-4ae2-b63d-7922a41ca462 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:59.896727 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c7902c94-2b33-40b5-a2d6-367901cce1b9 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:11:59.906738 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c7902c94-2b33-40b5-a2d6-367901cce1b9 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1443 microversion: 2.1 time: 0.499232 Dec 14 10:11:59.907584 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 291/566] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:59 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1443 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:11:59.912919 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-782aa390-17a3-4484-9337-34e9fc6322fd req-56a88961-6811-4405-828c-c8679f9669af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f0deec7-37f0-4eb9-bfa5-85b697768ad6", "tag": "8f8c2fb4-5866-4bb0-8bb1-0b8f4f6a5cd0"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:11:59.914733 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:11:59.914733 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:11:59.924497 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-782aa390-17a3-4484-9337-34e9fc6322fd req-56a88961-6811-4405-828c-c8679f9669af service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:59.924933 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-782aa390-17a3-4484-9337-34e9fc6322fd req-56a88961-6811-4405-828c-c8679f9669af service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:59.944953 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-782aa390-17a3-4484-9337-34e9fc6322fd req-56a88961-6811-4405-828c-c8679f9669af service nova] Creating event network-changed:8f8c2fb4-5866-4bb0-8bb1-0b8f4f6a5cd0 for instance 4f0deec7-37f0-4eb9-bfa5-85b697768ad6 on hv-cinder-81888 Dec 14 10:11:59.950796 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-782aa390-17a3-4484-9337-34e9fc6322fd req-56a88961-6811-4405-828c-c8679f9669af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041513 Dec 14 10:11:59.951395 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 292/567] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:11:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:11:59.956404 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a6109ef8-329b-4564-8d34-00ac906aa7cf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:11:59.957107 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-a6109ef8-329b-4564-8d34-00ac906aa7cf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:11:59.965092 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a6109ef8-329b-4564-8d34-00ac906aa7cf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:59.965545 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a6109ef8-329b-4564-8d34-00ac906aa7cf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:11:59.966349 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a6109ef8-329b-4564-8d34-00ac906aa7cf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:11:59.966778 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a6109ef8-329b-4564-8d34-00ac906aa7cf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:00.304001 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-a6109ef8-329b-4564-8d34-00ac906aa7cf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:00.315904 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a6109ef8-329b-4564-8d34-00ac906aa7cf tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e" status: 200 len: 1513 microversion: 2.1 time: 0.360896 Dec 14 10:12:00.315904 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 293/568] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:59 2021] GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e => generated 1513 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:00.319423 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a2671097-d254-4029-9dc0-ab6c1f659ca4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:00.320275 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-a2671097-d254-4029-9dc0-ab6c1f659ca4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:00.329587 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a2671097-d254-4029-9dc0-ab6c1f659ca4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:00.330323 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a2671097-d254-4029-9dc0-ab6c1f659ca4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:00.331196 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a2671097-d254-4029-9dc0-ab6c1f659ca4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:00.331690 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a2671097-d254-4029-9dc0-ab6c1f659ca4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:00.541573 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-a2671097-d254-4029-9dc0-ab6c1f659ca4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:00.550431 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a2671097-d254-4029-9dc0-ab6c1f659ca4 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1443 microversion: 2.1 time: 0.234916 Dec 14 10:12:00.551136 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 294/569] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:00 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1443 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:00.565749 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-da9ccbbd-ad13-4656-8515-115f1bc041c2 req-398a0585-7e35-4dca-94cd-9948dc3b1db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a09e3d56-a48c-4117-bd3f-6cecf8857a25", "name": "network-vif-deleted", "tag": "8700a3d2-b567-4851-a02f-46bf22ce6c5b"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:12:00.567590 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:12:00.567590 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:12:00.576495 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-da9ccbbd-ad13-4656-8515-115f1bc041c2 req-398a0585-7e35-4dca-94cd-9948dc3b1db9 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:00.576981 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-da9ccbbd-ad13-4656-8515-115f1bc041c2 req-398a0585-7e35-4dca-94cd-9948dc3b1db9 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:00.593771 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-da9ccbbd-ad13-4656-8515-115f1bc041c2 req-398a0585-7e35-4dca-94cd-9948dc3b1db9 service nova] Creating event network-vif-deleted:8700a3d2-b567-4851-a02f-46bf22ce6c5b for instance a09e3d56-a48c-4117-bd3f-6cecf8857a25 on hv-cinder-81888 Dec 14 10:12:00.598422 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-da9ccbbd-ad13-4656-8515-115f1bc041c2 req-398a0585-7e35-4dca-94cd-9948dc3b1db9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046230 Dec 14 10:12:00.599207 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 295/570] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:12:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:12:00.603834 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-25819dd2-1424-48bf-9e37-7a74923165c9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:00.604532 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-25819dd2-1424-48bf-9e37-7a74923165c9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:00.612499 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-25819dd2-1424-48bf-9e37-7a74923165c9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:00.612946 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-25819dd2-1424-48bf-9e37-7a74923165c9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:00.613715 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-25819dd2-1424-48bf-9e37-7a74923165c9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:00.614170 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-25819dd2-1424-48bf-9e37-7a74923165c9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:00.628586 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-7365dc54-71f0-4ae2-b63d-7922a41ca462 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:00.640260 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-7365dc54-71f0-4ae2-b63d-7922a41ca462 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6" status: 200 len: 1318 microversion: 2.1 time: 0.938252 Dec 14 10:12:00.641846 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 276/571] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:11:59 2021] GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6 => generated 1318 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:00.707316 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-bcc5bb74-5b2e-40ad-9f52-1462f08bc2b8 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:00.707934 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-bcc5bb74-5b2e-40ad-9f52-1462f08bc2b8 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:00.723685 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bcc5bb74-5b2e-40ad-9f52-1462f08bc2b8 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:00.724139 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bcc5bb74-5b2e-40ad-9f52-1462f08bc2b8 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:00.726884 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bcc5bb74-5b2e-40ad-9f52-1462f08bc2b8 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:00.727871 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bcc5bb74-5b2e-40ad-9f52-1462f08bc2b8 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:00.822104 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bcc5bb74-5b2e-40ad-9f52-1462f08bc2b8 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:00.823007 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bcc5bb74-5b2e-40ad-9f52-1462f08bc2b8 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:00.823557 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.objects.instance [None req-bcc5bb74-5b2e-40ad-9f52-1462f08bc2b8 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lazy-loading 'fault' on Instance uuid a09e3d56-a48c-4117-bd3f-6cecf8857a25 {{(pid=100985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:12:00.970044 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-bcc5bb74-5b2e-40ad-9f52-1462f08bc2b8 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2232ae85e2374690b7d4671b680be456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ddd272dc894d7bb0e1b6c0b6b7275d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:00.981845 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-bcc5bb74-5b2e-40ad-9f52-1462f08bc2b8 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 200 len: 1304 microversion: 2.1 time: 0.277975 Dec 14 10:12:00.991540 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-25819dd2-1424-48bf-9e37-7a74923165c9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:00.997280 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 277/572] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:00 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 1304 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:01.008730 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-25819dd2-1424-48bf-9e37-7a74923165c9 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1555 microversion: 2.1 time: 0.408532 Dec 14 10:12:01.009381 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 296/573] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:00 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1555 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:01.330879 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-8f861ff4-99ea-499e-a885-2394d6258962 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:01.331741 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-8f861ff4-99ea-499e-a885-2394d6258962 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:01.341609 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8f861ff4-99ea-499e-a885-2394d6258962 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:01.342488 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8f861ff4-99ea-499e-a885-2394d6258962 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:01.343902 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8f861ff4-99ea-499e-a885-2394d6258962 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:01.344456 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8f861ff4-99ea-499e-a885-2394d6258962 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:01.657371 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-831cbbb8-9a10-42ed-a6ec-dbee34d4dbf9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:01.658051 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-831cbbb8-9a10-42ed-a6ec-dbee34d4dbf9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: 4f0deec7-37f0-4eb9-bfa5-85b697768ad6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:01.666934 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-831cbbb8-9a10-42ed-a6ec-dbee34d4dbf9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:01.667583 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-831cbbb8-9a10-42ed-a6ec-dbee34d4dbf9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:01.668672 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-831cbbb8-9a10-42ed-a6ec-dbee34d4dbf9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:01.669111 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-831cbbb8-9a10-42ed-a6ec-dbee34d4dbf9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:01.924691 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-8f861ff4-99ea-499e-a885-2394d6258962 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:01.934430 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-8f861ff4-99ea-499e-a885-2394d6258962 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e" status: 200 len: 1513 microversion: 2.1 time: 0.607211 Dec 14 10:12:01.935033 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 278/574] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:01 2021] GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e => generated 1513 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:01.999452 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b093a7d4-c1d3-45b3-93b0-b22b373f1e14 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:01.999452 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-b093a7d4-c1d3-45b3-93b0-b22b373f1e14 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] [instance: a09e3d56-a48c-4117-bd3f-6cecf8857a25] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:02.014585 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b093a7d4-c1d3-45b3-93b0-b22b373f1e14 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:02.015325 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b093a7d4-c1d3-45b3-93b0-b22b373f1e14 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:02.016297 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b093a7d4-c1d3-45b3-93b0-b22b373f1e14 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:02.022760 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b093a7d4-c1d3-45b3-93b0-b22b373f1e14 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:02.133524 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-b093a7d4-c1d3-45b3-93b0-b22b373f1e14 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] HTTP exception thrown: Instance a09e3d56-a48c-4117-bd3f-6cecf8857a25 could not be found. Dec 14 10:12:02.134338 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b093a7d4-c1d3-45b3-93b0-b22b373f1e14 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] Returning 404 to user: Instance a09e3d56-a48c-4117-bd3f-6cecf8857a25 could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:12:02.136004 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-b093a7d4-c1d3-45b3-93b0-b22b373f1e14 tempest-VolumesNegativeTest-321506882 tempest-VolumesNegativeTest-321506882-project] 10.222.0.20 "GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25" status: 404 len: 111 microversion: 2.1 time: 0.141695 Dec 14 10:12:02.138897 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 279/575] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:01 2021] GET /compute/v2.1/servers/a09e3d56-a48c-4117-bd3f-6cecf8857a25 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:12:02.143792 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a39ca089-ac90-4d18-b8e9-f84e01e66222 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:02.148266 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a39ca089-ac90-4d18-b8e9-f84e01e66222 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:02.157522 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-831cbbb8-9a10-42ed-a6ec-dbee34d4dbf9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:02.168402 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a39ca089-ac90-4d18-b8e9-f84e01e66222 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:02.169073 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a39ca089-ac90-4d18-b8e9-f84e01e66222 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:02.170063 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a39ca089-ac90-4d18-b8e9-f84e01e66222 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:02.170660 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a39ca089-ac90-4d18-b8e9-f84e01e66222 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:02.187069 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-831cbbb8-9a10-42ed-a6ec-dbee34d4dbf9 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6" status: 200 len: 1318 microversion: 2.1 time: 0.530777 Dec 14 10:12:02.187886 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 297/576] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:01 2021] GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6 => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:12:02.322466 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-2ab896cb-4238-4706-9c76-0ca46f0d07b9 req-12d75398-af8f-495c-a423-aaff8eaab95c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "717b2959-9c01-4993-bfb1-3b85f4245f2e", "name": "network-vif-deleted", "tag": "09b07503-3722-4905-888c-f2166b4792da"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:12:02.326095 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:12:02.326095 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:12:02.352064 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-2ab896cb-4238-4706-9c76-0ca46f0d07b9 req-12d75398-af8f-495c-a423-aaff8eaab95c service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:02.352568 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-2ab896cb-4238-4706-9c76-0ca46f0d07b9 req-12d75398-af8f-495c-a423-aaff8eaab95c service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:02.391315 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-2ab896cb-4238-4706-9c76-0ca46f0d07b9 req-12d75398-af8f-495c-a423-aaff8eaab95c service nova] Creating event network-vif-deleted:09b07503-3722-4905-888c-f2166b4792da for instance 717b2959-9c01-4993-bfb1-3b85f4245f2e on hv-cinder-81888 Dec 14 10:12:02.397391 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-2ab896cb-4238-4706-9c76-0ca46f0d07b9 req-12d75398-af8f-495c-a423-aaff8eaab95c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080086 Dec 14 10:12:02.398455 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 298/577] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:12:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:12:02.714797 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-a39ca089-ac90-4d18-b8e9-f84e01e66222 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:02.726528 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a39ca089-ac90-4d18-b8e9-f84e01e66222 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1555 microversion: 2.1 time: 0.585652 Dec 14 10:12:02.727320 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 280/578] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:02 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1555 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:02.955376 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-9a933912-4e2d-4bff-8d32-c8d55e4ce7ba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:02.957446 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-9a933912-4e2d-4bff-8d32-c8d55e4ce7ba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:02.972968 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9a933912-4e2d-4bff-8d32-c8d55e4ce7ba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:02.973316 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9a933912-4e2d-4bff-8d32-c8d55e4ce7ba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:02.974304 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9a933912-4e2d-4bff-8d32-c8d55e4ce7ba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:02.974894 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9a933912-4e2d-4bff-8d32-c8d55e4ce7ba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:03.148351 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9a933912-4e2d-4bff-8d32-c8d55e4ce7ba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:03.149231 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9a933912-4e2d-4bff-8d32-c8d55e4ce7ba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:03.150358 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.objects.instance [None req-9a933912-4e2d-4bff-8d32-c8d55e4ce7ba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lazy-loading 'fault' on Instance uuid 717b2959-9c01-4993-bfb1-3b85f4245f2e {{(pid=100984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:12:03.204768 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f160ebe6-6b2d-442a-8d09-369aa7875572 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:03.205498 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f160ebe6-6b2d-442a-8d09-369aa7875572 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: 4f0deec7-37f0-4eb9-bfa5-85b697768ad6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:03.225949 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f160ebe6-6b2d-442a-8d09-369aa7875572 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:03.226407 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f160ebe6-6b2d-442a-8d09-369aa7875572 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:03.227283 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f160ebe6-6b2d-442a-8d09-369aa7875572 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:03.227701 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f160ebe6-6b2d-442a-8d09-369aa7875572 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:03.348090 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-9a933912-4e2d-4bff-8d32-c8d55e4ce7ba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:03.359909 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-9a933912-4e2d-4bff-8d32-c8d55e4ce7ba tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e" status: 200 len: 1307 microversion: 2.1 time: 0.410919 Dec 14 10:12:03.371533 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 299/579] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:02 2021] GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e => generated 1307 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:03.520679 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-30149ac5-49a6-444e-afe7-ac8d5791ea84 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:03.521537 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-30149ac5-49a6-444e-afe7-ac8d5791ea84 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:03.531203 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-30149ac5-49a6-444e-afe7-ac8d5791ea84 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:03.534619 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-30149ac5-49a6-444e-afe7-ac8d5791ea84 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:03.538665 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-30149ac5-49a6-444e-afe7-ac8d5791ea84 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:03.539372 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-30149ac5-49a6-444e-afe7-ac8d5791ea84 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:03.549312 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f160ebe6-6b2d-442a-8d09-369aa7875572 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:03.560562 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f160ebe6-6b2d-442a-8d09-369aa7875572 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6" status: 200 len: 1318 microversion: 2.1 time: 0.359635 Dec 14 10:12:03.561134 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 281/580] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:03 2021] GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:03.744608 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3b07faef-f0d8-4a57-9276-8659816cc3de tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:03.744965 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3b07faef-f0d8-4a57-9276-8659816cc3de tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:03.753835 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3b07faef-f0d8-4a57-9276-8659816cc3de tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:03.754640 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3b07faef-f0d8-4a57-9276-8659816cc3de tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:03.755812 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3b07faef-f0d8-4a57-9276-8659816cc3de tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:03.756473 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3b07faef-f0d8-4a57-9276-8659816cc3de tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:04.013235 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-30149ac5-49a6-444e-afe7-ac8d5791ea84 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:04.024358 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-30149ac5-49a6-444e-afe7-ac8d5791ea84 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1593 microversion: 2.1 time: 0.507275 Dec 14 10:12:04.027811 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 300/581] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:03 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1593 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:04.041700 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3b07faef-f0d8-4a57-9276-8659816cc3de tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:04.052800 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3b07faef-f0d8-4a57-9276-8659816cc3de tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1561 microversion: 2.1 time: 0.311968 Dec 14 10:12:04.054014 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 282/582] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:03 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1561 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:12:04.174295 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1425c5cf-85f2-4c26-b06a-205ace03cbad tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:04.174789 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1425c5cf-85f2-4c26-b06a-205ace03cbad tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:04.189780 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1425c5cf-85f2-4c26-b06a-205ace03cbad tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:04.193940 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1425c5cf-85f2-4c26-b06a-205ace03cbad tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:04.194770 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1425c5cf-85f2-4c26-b06a-205ace03cbad tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:04.195208 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1425c5cf-85f2-4c26-b06a-205ace03cbad tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:04.394911 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-39448190-7ffa-458e-85d5-374c808f756c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:04.397864 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-39448190-7ffa-458e-85d5-374c808f756c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 717b2959-9c01-4993-bfb1-3b85f4245f2e] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:04.461268 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-39448190-7ffa-458e-85d5-374c808f756c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:04.461777 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-39448190-7ffa-458e-85d5-374c808f756c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:04.462718 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-39448190-7ffa-458e-85d5-374c808f756c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:04.463413 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-39448190-7ffa-458e-85d5-374c808f756c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:04.541935 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-39448190-7ffa-458e-85d5-374c808f756c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] HTTP exception thrown: Instance 717b2959-9c01-4993-bfb1-3b85f4245f2e could not be found. Dec 14 10:12:04.543565 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-39448190-7ffa-458e-85d5-374c808f756c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Returning 404 to user: Instance 717b2959-9c01-4993-bfb1-3b85f4245f2e could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:12:04.544783 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-39448190-7ffa-458e-85d5-374c808f756c tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e" status: 404 len: 111 microversion: 2.1 time: 0.168807 Dec 14 10:12:04.545936 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 283/583] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:04 2021] GET /compute/v2.1/servers/717b2959-9c01-4993-bfb1-3b85f4245f2e => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:12:04.546079 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.objects.instance [None req-1425c5cf-85f2-4c26-b06a-205ace03cbad tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lazy-loading 'services' on Instance uuid 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd {{(pid=100984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:12:04.568051 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-d33f4c6c-b35a-4969-9547-5b385d27cd29 req-3003e7c2-0818-4101-a959-692644699929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "731c99da-4633-4de9-9678-02e9fecda7b4", "tag": "eb309f74-48d9-4eb5-98e8-7571414fa330"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:12:04.580148 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:12:04.580148 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:12:04.616228 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-d33f4c6c-b35a-4969-9547-5b385d27cd29 req-3003e7c2-0818-4101-a959-692644699929 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:04.617125 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-d33f4c6c-b35a-4969-9547-5b385d27cd29 req-3003e7c2-0818-4101-a959-692644699929 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:04.678547 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-d33f4c6c-b35a-4969-9547-5b385d27cd29 req-3003e7c2-0818-4101-a959-692644699929 service nova] Creating event network-changed:eb309f74-48d9-4eb5-98e8-7571414fa330 for instance 731c99da-4633-4de9-9678-02e9fecda7b4 on hv-cinder-81888 Dec 14 10:12:04.695248 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-d33f4c6c-b35a-4969-9547-5b385d27cd29 req-3003e7c2-0818-4101-a959-692644699929 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145854 Dec 14 10:12:04.697041 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 284/584] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:12:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:12:04.735948 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3af2fe9b-698a-4041-bf26-758286a12276 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:04.737424 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3af2fe9b-698a-4041-bf26-758286a12276 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: 4f0deec7-37f0-4eb9-bfa5-85b697768ad6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:04.755824 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3af2fe9b-698a-4041-bf26-758286a12276 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:04.756977 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3af2fe9b-698a-4041-bf26-758286a12276 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:04.760527 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3af2fe9b-698a-4041-bf26-758286a12276 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:04.761640 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3af2fe9b-698a-4041-bf26-758286a12276 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:04.819006 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1425c5cf-85f2-4c26-b06a-205ace03cbad tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/os-volume_attachments/f71d54b6-0d2a-4075-90fe-81d02953deae" status: 202 len: 0 microversion: 2.1 time: 0.648302 Dec 14 10:12:04.819619 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 301/585] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Dec 14 10:12:04 2021] DELETE /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/os-volume_attachments/f71d54b6-0d2a-4075-90fe-81d02953deae => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:12:04.829526 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f48af9b3-a0e3-43c4-8430-8b1505e33eac tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:04.830602 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f48af9b3-a0e3-43c4-8430-8b1505e33eac tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:04.867529 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f48af9b3-a0e3-43c4-8430-8b1505e33eac tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:04.867998 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f48af9b3-a0e3-43c4-8430-8b1505e33eac tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:04.868793 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f48af9b3-a0e3-43c4-8430-8b1505e33eac tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:04.869230 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f48af9b3-a0e3-43c4-8430-8b1505e33eac tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:05.031067 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f48af9b3-a0e3-43c4-8430-8b1505e33eac tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205515 Dec 14 10:12:05.034289 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 302/586] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:12:04 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:12:05.593345 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3af2fe9b-698a-4041-bf26-758286a12276 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:05.601843 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3af2fe9b-698a-4041-bf26-758286a12276 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6" status: 200 len: 1318 microversion: 2.1 time: 0.901551 Dec 14 10:12:05.602443 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 285/587] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:04 2021] GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6 => generated 1318 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:05.857884 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-5057fa62-3549-4bca-a5d6-f0a4e71a86fd req-bd5c0934-65d1-401f-a35d-893a657f33d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0deec7-37f0-4eb9-bfa5-85b697768ad6", "name": "network-vif-plugged", "status": "completed", "tag": "8f8c2fb4-5866-4bb0-8bb1-0b8f4f6a5cd0"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:12:05.859794 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:12:05.859794 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:12:05.878125 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-5057fa62-3549-4bca-a5d6-f0a4e71a86fd req-bd5c0934-65d1-401f-a35d-893a657f33d6 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:05.878723 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-5057fa62-3549-4bca-a5d6-f0a4e71a86fd req-bd5c0934-65d1-401f-a35d-893a657f33d6 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:05.915018 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-5057fa62-3549-4bca-a5d6-f0a4e71a86fd req-bd5c0934-65d1-401f-a35d-893a657f33d6 service nova] Creating event network-vif-plugged:8f8c2fb4-5866-4bb0-8bb1-0b8f4f6a5cd0 for instance 4f0deec7-37f0-4eb9-bfa5-85b697768ad6 on hv-cinder-81888 Dec 14 10:12:05.929536 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-5057fa62-3549-4bca-a5d6-f0a4e71a86fd req-bd5c0934-65d1-401f-a35d-893a657f33d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075958 Dec 14 10:12:05.930181 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 303/588] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:12:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:12:06.033945 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6979f003-6149-48a7-9cfe-c3a3d8521647 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:06.034649 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6979f003-6149-48a7-9cfe-c3a3d8521647 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:06.043701 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-52a1f1dd-406b-472b-a23a-aa86d1f94e5f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:06.044986 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-52a1f1dd-406b-472b-a23a-aa86d1f94e5f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:06.060913 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6979f003-6149-48a7-9cfe-c3a3d8521647 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:06.061362 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6979f003-6149-48a7-9cfe-c3a3d8521647 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:06.062188 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6979f003-6149-48a7-9cfe-c3a3d8521647 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:06.062628 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6979f003-6149-48a7-9cfe-c3a3d8521647 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:06.068214 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-52a1f1dd-406b-472b-a23a-aa86d1f94e5f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:06.068660 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-52a1f1dd-406b-472b-a23a-aa86d1f94e5f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:06.069443 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-52a1f1dd-406b-472b-a23a-aa86d1f94e5f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:06.069874 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-52a1f1dd-406b-472b-a23a-aa86d1f94e5f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:06.210803 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-52a1f1dd-406b-472b-a23a-aa86d1f94e5f tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171682 Dec 14 10:12:06.211557 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 304/589] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:12:06 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:12:06.216055 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6979f003-6149-48a7-9cfe-c3a3d8521647 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Going to try to terminate instance {{(pid=100985) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:12:06.389264 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6979f003-6149-48a7-9cfe-c3a3d8521647 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 204 len: 0 microversion: 2.1 time: 0.358615 Dec 14 10:12:06.390718 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 286/590] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:12:06 2021] DELETE /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 10:12:06.399286 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-54233ed6-0217-49cc-989d-dfc550f20702 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:06.400678 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-54233ed6-0217-49cc-989d-dfc550f20702 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:06.412956 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-54233ed6-0217-49cc-989d-dfc550f20702 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:06.413633 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-54233ed6-0217-49cc-989d-dfc550f20702 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:06.414891 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-54233ed6-0217-49cc-989d-dfc550f20702 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:06.415465 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-54233ed6-0217-49cc-989d-dfc550f20702 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:06.619296 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-27564d70-8ce8-45f0-a7ae-b3bed2548034 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:06.620065 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-27564d70-8ce8-45f0-a7ae-b3bed2548034 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: 4f0deec7-37f0-4eb9-bfa5-85b697768ad6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:06.631640 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-27564d70-8ce8-45f0-a7ae-b3bed2548034 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:06.632957 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-27564d70-8ce8-45f0-a7ae-b3bed2548034 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:06.635067 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-27564d70-8ce8-45f0-a7ae-b3bed2548034 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:06.637744 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-27564d70-8ce8-45f0-a7ae-b3bed2548034 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:06.730864 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-54233ed6-0217-49cc-989d-dfc550f20702 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:06.739348 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-54233ed6-0217-49cc-989d-dfc550f20702 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1512 microversion: 2.1 time: 0.344391 Dec 14 10:12:06.740007 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 305/591] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:06 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1512 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:06.994860 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-27564d70-8ce8-45f0-a7ae-b3bed2548034 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:07.006386 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-27564d70-8ce8-45f0-a7ae-b3bed2548034 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6" status: 200 len: 1318 microversion: 2.1 time: 0.391180 Dec 14 10:12:07.016472 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 287/592] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:06 2021] GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6 => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:12:07.230847 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f3cd24f1-f1c3-4bc6-b33c-25de29adb952 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:07.234061 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f3cd24f1-f1c3-4bc6-b33c-25de29adb952 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:07.243971 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f3cd24f1-f1c3-4bc6-b33c-25de29adb952 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:07.244581 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f3cd24f1-f1c3-4bc6-b33c-25de29adb952 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:07.245158 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f3cd24f1-f1c3-4bc6-b33c-25de29adb952 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:07.246148 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f3cd24f1-f1c3-4bc6-b33c-25de29adb952 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:07.325408 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f3cd24f1-f1c3-4bc6-b33c-25de29adb952 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106138 Dec 14 10:12:07.326194 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 306/593] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:12:07 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 10:12:07.756587 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-d6a3c640-2ed8-4c6b-9d1c-ed1946d24a3d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:07.757205 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-d6a3c640-2ed8-4c6b-9d1c-ed1946d24a3d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:07.764491 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d6a3c640-2ed8-4c6b-9d1c-ed1946d24a3d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:07.764939 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d6a3c640-2ed8-4c6b-9d1c-ed1946d24a3d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:07.766265 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d6a3c640-2ed8-4c6b-9d1c-ed1946d24a3d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:07.766367 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d6a3c640-2ed8-4c6b-9d1c-ed1946d24a3d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:08.023010 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a4550807-f9d3-4a5b-9afe-8ca92dd1b145 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:08.023836 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-a4550807-f9d3-4a5b-9afe-8ca92dd1b145 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: 4f0deec7-37f0-4eb9-bfa5-85b697768ad6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:08.032123 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a4550807-f9d3-4a5b-9afe-8ca92dd1b145 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:08.032810 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a4550807-f9d3-4a5b-9afe-8ca92dd1b145 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:08.033673 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a4550807-f9d3-4a5b-9afe-8ca92dd1b145 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:08.034226 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a4550807-f9d3-4a5b-9afe-8ca92dd1b145 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:08.239885 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-a4550807-f9d3-4a5b-9afe-8ca92dd1b145 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:08.249381 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a4550807-f9d3-4a5b-9afe-8ca92dd1b145 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6" status: 200 len: 1318 microversion: 2.1 time: 0.229928 Dec 14 10:12:08.249960 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 307/594] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:08 2021] GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:12:08.299805 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-d6a3c640-2ed8-4c6b-9d1c-ed1946d24a3d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:08.308637 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-d6a3c640-2ed8-4c6b-9d1c-ed1946d24a3d tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1512 microversion: 2.1 time: 0.555389 Dec 14 10:12:08.309615 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 288/595] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:07 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1512 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:08.423199 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-37690df6-bc5a-43f2-a1d6-23731be72d45 req-7a921740-812e-46cc-a419-1b473d8c5db1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b8c891-6fe6-4b09-8254-77c354e67aaa", "tag": "35d84917-4bee-46b2-a5e4-3ff2c82add1c"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:12:08.425139 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:12:08.425139 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:12:08.436685 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-37690df6-bc5a-43f2-a1d6-23731be72d45 req-7a921740-812e-46cc-a419-1b473d8c5db1 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:08.437434 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-37690df6-bc5a-43f2-a1d6-23731be72d45 req-7a921740-812e-46cc-a419-1b473d8c5db1 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:08.484354 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-37690df6-bc5a-43f2-a1d6-23731be72d45 req-7a921740-812e-46cc-a419-1b473d8c5db1 service nova] Creating event network-changed:35d84917-4bee-46b2-a5e4-3ff2c82add1c for instance 12b8c891-6fe6-4b09-8254-77c354e67aaa on hv-cinder-81888 Dec 14 10:12:08.490293 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-37690df6-bc5a-43f2-a1d6-23731be72d45 req-7a921740-812e-46cc-a419-1b473d8c5db1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072808 Dec 14 10:12:08.491516 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 308/596] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:12:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:12:09.281684 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-897d4ab4-5076-4ce4-9c9c-429d062a0101 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:09.291896 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-897d4ab4-5076-4ce4-9c9c-429d062a0101 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: 4f0deec7-37f0-4eb9-bfa5-85b697768ad6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:09.306061 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-897d4ab4-5076-4ce4-9c9c-429d062a0101 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:09.306912 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-897d4ab4-5076-4ce4-9c9c-429d062a0101 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:09.309160 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-897d4ab4-5076-4ce4-9c9c-429d062a0101 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:09.309766 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-897d4ab4-5076-4ce4-9c9c-429d062a0101 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:09.327578 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-cd250e06-83ce-4730-9fa9-b5adaccd1f04 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:09.328567 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-cd250e06-83ce-4730-9fa9-b5adaccd1f04 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:09.342685 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cd250e06-83ce-4730-9fa9-b5adaccd1f04 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:09.343174 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cd250e06-83ce-4730-9fa9-b5adaccd1f04 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:09.343932 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cd250e06-83ce-4730-9fa9-b5adaccd1f04 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:09.344361 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cd250e06-83ce-4730-9fa9-b5adaccd1f04 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:09.623409 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-cd250e06-83ce-4730-9fa9-b5adaccd1f04 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:09.634856 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-cd250e06-83ce-4730-9fa9-b5adaccd1f04 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1512 microversion: 2.1 time: 0.312763 Dec 14 10:12:09.635910 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 309/597] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:09 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1512 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:12:10.015552 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-897d4ab4-5076-4ce4-9c9c-429d062a0101 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:10.018591 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-bd73e0dd-c2bb-41f8-a640-aed2ed49d0aa tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:10.021292 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-bd73e0dd-c2bb-41f8-a640-aed2ed49d0aa tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:10.040221 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-897d4ab4-5076-4ce4-9c9c-429d062a0101 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6" status: 200 len: 1507 microversion: 2.1 time: 0.776993 Dec 14 10:12:10.041999 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bd73e0dd-c2bb-41f8-a640-aed2ed49d0aa tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:10.043053 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 289/598] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:09 2021] GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6 => generated 1507 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:10.043690 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bd73e0dd-c2bb-41f8-a640-aed2ed49d0aa tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:10.044875 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bd73e0dd-c2bb-41f8-a640-aed2ed49d0aa tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:10.045448 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bd73e0dd-c2bb-41f8-a640-aed2ed49d0aa tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:10.057428 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-dc54e346-cf67-4ed6-ae91-6f418eb5c481 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "440c9ca7-15ca-4b58-a4da-462018766e1f", "device": "/dev/sdb"}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:12:10.059466 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-dc54e346-cf67-4ed6-ae91-6f418eb5c481 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: 4f0deec7-37f0-4eb9-bfa5-85b697768ad6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:10.073015 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dc54e346-cf67-4ed6-ae91-6f418eb5c481 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:10.078610 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dc54e346-cf67-4ed6-ae91-6f418eb5c481 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:10.079424 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dc54e346-cf67-4ed6-ae91-6f418eb5c481 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:10.079865 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dc54e346-cf67-4ed6-ae91-6f418eb5c481 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:10.160578 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-bd73e0dd-c2bb-41f8-a640-aed2ed49d0aa tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Going to try to terminate instance {{(pid=100984) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:12:10.341017 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-bd73e0dd-c2bb-41f8-a640-aed2ed49d0aa tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 204 len: 0 microversion: 2.1 time: 0.331693 Dec 14 10:12:10.342321 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 310/599] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:12:10 2021] DELETE /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 14 10:12:10.352100 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c4b04a17-767b-43ff-a842-483e6f168ca6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:10.353573 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c4b04a17-767b-43ff-a842-483e6f168ca6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:10.363813 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c4b04a17-767b-43ff-a842-483e6f168ca6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:10.364448 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c4b04a17-767b-43ff-a842-483e6f168ca6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:10.365581 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c4b04a17-767b-43ff-a842-483e6f168ca6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:10.366454 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c4b04a17-767b-43ff-a842-483e6f168ca6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:10.603045 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-dc54e346-cf67-4ed6-ae91-6f418eb5c481 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "POST /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.549736 Dec 14 10:12:10.604005 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 290/600] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Dec 14 10:12:10 2021] POST /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6/os-volume_attachments => generated 194 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:12:10.656269 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-5e7aca19-9282-4b90-82a6-79a83e292a68 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:10.657328 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-5e7aca19-9282-4b90-82a6-79a83e292a68 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:10.668914 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5e7aca19-9282-4b90-82a6-79a83e292a68 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:10.669596 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5e7aca19-9282-4b90-82a6-79a83e292a68 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:10.670660 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5e7aca19-9282-4b90-82a6-79a83e292a68 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:10.671247 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5e7aca19-9282-4b90-82a6-79a83e292a68 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:10.790337 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c4b04a17-767b-43ff-a842-483e6f168ca6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:10.809616 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c4b04a17-767b-43ff-a842-483e6f168ca6 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1507 microversion: 2.1 time: 0.461880 Dec 14 10:12:10.810777 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 311/601] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:10 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1507 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:10.815183 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-ff1d95cd-a7d8-4ba4-81b8-b1ca181e16ad req-3d357629-7f44-4ffd-8234-489b94c5cb08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b66506-2460-4284-aa1e-c7b2f368bb75", "name": "network-vif-deleted", "tag": "3b355350-b30b-4000-9798-cdf47cd7eb43"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:12:10.816705 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:12:10.816705 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:12:10.825897 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-ff1d95cd-a7d8-4ba4-81b8-b1ca181e16ad req-3d357629-7f44-4ffd-8234-489b94c5cb08 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:10.826383 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-ff1d95cd-a7d8-4ba4-81b8-b1ca181e16ad req-3d357629-7f44-4ffd-8234-489b94c5cb08 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:10.849791 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-5e7aca19-9282-4b90-82a6-79a83e292a68 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ac29796a444ae88d119870a479baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d21e35946242e9b067686ed5f812ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:10.853740 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-ff1d95cd-a7d8-4ba4-81b8-b1ca181e16ad req-3d357629-7f44-4ffd-8234-489b94c5cb08 service nova] Creating event network-vif-deleted:3b355350-b30b-4000-9798-cdf47cd7eb43 for instance 35b66506-2460-4284-aa1e-c7b2f368bb75 on hv-cinder-81888 Dec 14 10:12:10.860801 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-ff1d95cd-a7d8-4ba4-81b8-b1ca181e16ad req-3d357629-7f44-4ffd-8234-489b94c5cb08 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048733 Dec 14 10:12:10.861577 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 312/602] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:12:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:12:10.864214 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-5e7aca19-9282-4b90-82a6-79a83e292a68 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 200 len: 1470 microversion: 2.1 time: 0.214932 Dec 14 10:12:10.865518 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 291/603] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:10 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 1470 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:12:10.993828 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-13667b9a-7f3c-4004-9cfe-cf04994f0470 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-72617066"}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:12:10.994590 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-13667b9a-7f3c-4004-9cfe-cf04994f0470 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:11.002289 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-13667b9a-7f3c-4004-9cfe-cf04994f0470 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:11.002797 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-13667b9a-7f3c-4004-9cfe-cf04994f0470 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:11.003782 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-13667b9a-7f3c-4004-9cfe-cf04994f0470 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:11.004275 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-13667b9a-7f3c-4004-9cfe-cf04994f0470 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:11.215785 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.network.security_group_api [None req-13667b9a-7f3c-4004-9cfe-cf04994f0470 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Adding security group e7edf751-f9d6-4f9e-a223-6d90a7db3f33 to port 35d84917-4bee-46b2-a5e4-3ff2c82add1c Dec 14 10:12:11.721844 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-13667b9a-7f3c-4004-9cfe-cf04994f0470 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "POST /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa/action" status: 202 len: 0 microversion: 2.1 time: 0.732451 Dec 14 10:12:11.722518 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 313/604] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:12:10 2021] POST /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa/action => generated 0 bytes in 734 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:12:11.732740 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-ddc48d0f-2eea-4797-8a53-c28c628b08a2 req-81b6ac06-b06e-42c4-a7e0-9b22b9e4614c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b8c891-6fe6-4b09-8254-77c354e67aaa", "tag": "35d84917-4bee-46b2-a5e4-3ff2c82add1c"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:12:11.734802 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:12:11.734802 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:12:11.737870 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c95723bc-32ef-44d6-8fd7-0cb9d5ec9e56 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:11.741194 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c95723bc-32ef-44d6-8fd7-0cb9d5ec9e56 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:11.755967 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-ddc48d0f-2eea-4797-8a53-c28c628b08a2 req-81b6ac06-b06e-42c4-a7e0-9b22b9e4614c service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:11.756956 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-ddc48d0f-2eea-4797-8a53-c28c628b08a2 req-81b6ac06-b06e-42c4-a7e0-9b22b9e4614c service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:11.759083 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c95723bc-32ef-44d6-8fd7-0cb9d5ec9e56 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:11.759530 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c95723bc-32ef-44d6-8fd7-0cb9d5ec9e56 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:11.760311 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c95723bc-32ef-44d6-8fd7-0cb9d5ec9e56 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:11.763049 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c95723bc-32ef-44d6-8fd7-0cb9d5ec9e56 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:11.779015 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-ddc48d0f-2eea-4797-8a53-c28c628b08a2 req-81b6ac06-b06e-42c4-a7e0-9b22b9e4614c service nova] Creating event network-changed:35d84917-4bee-46b2-a5e4-3ff2c82add1c for instance 12b8c891-6fe6-4b09-8254-77c354e67aaa on hv-cinder-81888 Dec 14 10:12:11.784395 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-ddc48d0f-2eea-4797-8a53-c28c628b08a2 req-81b6ac06-b06e-42c4-a7e0-9b22b9e4614c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055907 Dec 14 10:12:11.787432 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 314/605] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:12:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:12:11.830250 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f390157d-0bf9-49d0-9d35-527bc98c6130 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:11.831248 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f390157d-0bf9-49d0-9d35-527bc98c6130 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:11.841065 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f390157d-0bf9-49d0-9d35-527bc98c6130 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:11.842190 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f390157d-0bf9-49d0-9d35-527bc98c6130 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:11.843300 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f390157d-0bf9-49d0-9d35-527bc98c6130 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:11.844003 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f390157d-0bf9-49d0-9d35-527bc98c6130 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:12.091312 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-f390157d-0bf9-49d0-9d35-527bc98c6130 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:12.100356 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f390157d-0bf9-49d0-9d35-527bc98c6130 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1507 microversion: 2.1 time: 0.277148 Dec 14 10:12:12.101250 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 315/606] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:11 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:12.105827 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-74071203-a30f-430b-ad54-d3007f225b98 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:12.106665 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-74071203-a30f-430b-ad54-d3007f225b98 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] [instance: 35b66506-2460-4284-aa1e-c7b2f368bb75] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:12.114263 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-74071203-a30f-430b-ad54-d3007f225b98 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:12.114710 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-74071203-a30f-430b-ad54-d3007f225b98 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:12.115490 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-74071203-a30f-430b-ad54-d3007f225b98 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:12.116153 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-74071203-a30f-430b-ad54-d3007f225b98 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:12.168925 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-74071203-a30f-430b-ad54-d3007f225b98 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] HTTP exception thrown: Instance 35b66506-2460-4284-aa1e-c7b2f368bb75 could not be found. Dec 14 10:12:12.169526 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-74071203-a30f-430b-ad54-d3007f225b98 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] Returning 404 to user: Instance 35b66506-2460-4284-aa1e-c7b2f368bb75 could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:12:12.170447 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-74071203-a30f-430b-ad54-d3007f225b98 tempest-AttachVolumeNegativeTest-1322843954 tempest-AttachVolumeNegativeTest-1322843954-project] 10.222.0.20 "GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75" status: 404 len: 111 microversion: 2.1 time: 0.068021 Dec 14 10:12:12.171005 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 316/607] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:12 2021] GET /compute/v2.1/servers/35b66506-2460-4284-aa1e-c7b2f368bb75 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:12:12.254959 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-c95723bc-32ef-44d6-8fd7-0cb9d5ec9e56 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:12.269836 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c95723bc-32ef-44d6-8fd7-0cb9d5ec9e56 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1757 microversion: 2.1 time: 0.542785 Dec 14 10:12:12.282118 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 292/608] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:11 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1757 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:13.118758 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d61f2c56-7b81-4101-9cf2-f912f3b6538a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:13.119589 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d61f2c56-7b81-4101-9cf2-f912f3b6538a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:13.127848 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d61f2c56-7b81-4101-9cf2-f912f3b6538a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:13.128416 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d61f2c56-7b81-4101-9cf2-f912f3b6538a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:13.129276 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d61f2c56-7b81-4101-9cf2-f912f3b6538a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:13.129916 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d61f2c56-7b81-4101-9cf2-f912f3b6538a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:13.369731 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d61f2c56-7b81-4101-9cf2-f912f3b6538a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:13.378825 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d61f2c56-7b81-4101-9cf2-f912f3b6538a tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1507 microversion: 2.1 time: 0.263695 Dec 14 10:12:13.379390 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 317/609] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:13 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1507 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:14.360292 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-81d0ec09-c9ad-4dec-8778-74e3d7144395 req-6cef43ca-70fa-4546-83d1-78cf5946bd27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b7ee709-3cab-4f17-8b02-919fd03e733d", "name": "network-vif-deleted", "tag": "3937de4c-40a7-4ab1-84ef-8bcc52206b8b"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:12:14.361932 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:12:14.361932 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:12:14.371780 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-81d0ec09-c9ad-4dec-8778-74e3d7144395 req-6cef43ca-70fa-4546-83d1-78cf5946bd27 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:14.372231 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-81d0ec09-c9ad-4dec-8778-74e3d7144395 req-6cef43ca-70fa-4546-83d1-78cf5946bd27 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:14.393519 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-81d0ec09-c9ad-4dec-8778-74e3d7144395 req-6cef43ca-70fa-4546-83d1-78cf5946bd27 service nova] Creating event network-vif-deleted:3937de4c-40a7-4ab1-84ef-8bcc52206b8b for instance 5b7ee709-3cab-4f17-8b02-919fd03e733d on hv-cinder-81888 Dec 14 10:12:14.396007 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-3573bdfb-75c9-4e79-bc3c-5f9f5cea7b51 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:14.396622 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-3573bdfb-75c9-4e79-bc3c-5f9f5cea7b51 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:14.398359 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-81d0ec09-c9ad-4dec-8778-74e3d7144395 req-6cef43ca-70fa-4546-83d1-78cf5946bd27 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042318 Dec 14 10:12:14.398950 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 293/610] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:12:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:12:14.407690 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3573bdfb-75c9-4e79-bc3c-5f9f5cea7b51 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:14.408716 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3573bdfb-75c9-4e79-bc3c-5f9f5cea7b51 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:14.416374 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3573bdfb-75c9-4e79-bc3c-5f9f5cea7b51 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:14.417167 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3573bdfb-75c9-4e79-bc3c-5f9f5cea7b51 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:14.547916 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-3573bdfb-75c9-4e79-bc3c-5f9f5cea7b51 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:14.556363 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-3573bdfb-75c9-4e79-bc3c-5f9f5cea7b51 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 200 len: 1293 microversion: 2.1 time: 0.164059 Dec 14 10:12:14.556933 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 318/611] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:14 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 1293 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:12:15.574623 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6db4e9fb-f127-40d9-a3e3-44d3ef3345ca tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:15.575387 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6db4e9fb-f127-40d9-a3e3-44d3ef3345ca tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 5b7ee709-3cab-4f17-8b02-919fd03e733d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:15.582686 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6db4e9fb-f127-40d9-a3e3-44d3ef3345ca tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:15.583133 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6db4e9fb-f127-40d9-a3e3-44d3ef3345ca tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:15.583901 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6db4e9fb-f127-40d9-a3e3-44d3ef3345ca tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:15.584403 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6db4e9fb-f127-40d9-a3e3-44d3ef3345ca tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:15.636698 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-6db4e9fb-f127-40d9-a3e3-44d3ef3345ca tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] HTTP exception thrown: Instance 5b7ee709-3cab-4f17-8b02-919fd03e733d could not be found. Dec 14 10:12:15.637305 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6db4e9fb-f127-40d9-a3e3-44d3ef3345ca tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Returning 404 to user: Instance 5b7ee709-3cab-4f17-8b02-919fd03e733d could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:12:15.638160 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6db4e9fb-f127-40d9-a3e3-44d3ef3345ca tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d" status: 404 len: 111 microversion: 2.1 time: 0.068325 Dec 14 10:12:15.638710 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 294/612] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:15 2021] GET /compute/v2.1/servers/5b7ee709-3cab-4f17-8b02-919fd03e733d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:12:15.646886 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-3443c651-1958-4803-8e87-d72308187bcd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:15.647423 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-3443c651-1958-4803-8e87-d72308187bcd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:15.655098 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3443c651-1958-4803-8e87-d72308187bcd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:15.655544 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3443c651-1958-4803-8e87-d72308187bcd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:15.656313 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3443c651-1958-4803-8e87-d72308187bcd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:15.656744 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3443c651-1958-4803-8e87-d72308187bcd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:15.719710 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-3443c651-1958-4803-8e87-d72308187bcd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Going to try to terminate instance {{(pid=100984) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:12:15.836660 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-3443c651-1958-4803-8e87-d72308187bcd tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 204 len: 0 microversion: 2.1 time: 0.193268 Dec 14 10:12:15.837326 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 319/613] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:12:15 2021] DELETE /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 10:12:15.845283 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-512337d3-70cd-4dab-b6ab-c95406e5ef29 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:15.845920 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-512337d3-70cd-4dab-b6ab-c95406e5ef29 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:15.853633 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-512337d3-70cd-4dab-b6ab-c95406e5ef29 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:15.854119 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-512337d3-70cd-4dab-b6ab-c95406e5ef29 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:15.855448 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-512337d3-70cd-4dab-b6ab-c95406e5ef29 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:15.856053 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-512337d3-70cd-4dab-b6ab-c95406e5ef29 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:16.082943 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-512337d3-70cd-4dab-b6ab-c95406e5ef29 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:16.091838 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-512337d3-70cd-4dab-b6ab-c95406e5ef29 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.250316 Dec 14 10:12:16.092514 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 295/614] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:15 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:12:17.110110 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-265fc4f1-4bdc-4131-a41c-a8592dccad93 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:17.110922 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-265fc4f1-4bdc-4131-a41c-a8592dccad93 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:17.118577 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-265fc4f1-4bdc-4131-a41c-a8592dccad93 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:17.119092 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-265fc4f1-4bdc-4131-a41c-a8592dccad93 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:17.120464 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-265fc4f1-4bdc-4131-a41c-a8592dccad93 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:17.121279 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-265fc4f1-4bdc-4131-a41c-a8592dccad93 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:17.345115 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-265fc4f1-4bdc-4131-a41c-a8592dccad93 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:17.352507 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-265fc4f1-4bdc-4131-a41c-a8592dccad93 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.247404 Dec 14 10:12:17.353079 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 320/615] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:17 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:18.370016 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-46a9d369-ef4e-4c06-82d8-b7cc7fb9ff8c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:18.370820 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-46a9d369-ef4e-4c06-82d8-b7cc7fb9ff8c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:18.378825 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-46a9d369-ef4e-4c06-82d8-b7cc7fb9ff8c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:18.379265 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-46a9d369-ef4e-4c06-82d8-b7cc7fb9ff8c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:18.380029 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-46a9d369-ef4e-4c06-82d8-b7cc7fb9ff8c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:18.380456 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-46a9d369-ef4e-4c06-82d8-b7cc7fb9ff8c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:18.688712 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-46a9d369-ef4e-4c06-82d8-b7cc7fb9ff8c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:18.699483 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-46a9d369-ef4e-4c06-82d8-b7cc7fb9ff8c tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.333367 Dec 14 10:12:18.700377 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 296/616] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:18 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:19.717481 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5dabfd72-8e1a-475a-8d58-1ffa12980966 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:19.718033 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5dabfd72-8e1a-475a-8d58-1ffa12980966 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:19.726026 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5dabfd72-8e1a-475a-8d58-1ffa12980966 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:19.726875 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5dabfd72-8e1a-475a-8d58-1ffa12980966 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:19.727834 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5dabfd72-8e1a-475a-8d58-1ffa12980966 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:19.728430 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5dabfd72-8e1a-475a-8d58-1ffa12980966 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:19.938006 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5dabfd72-8e1a-475a-8d58-1ffa12980966 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:19.945890 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5dabfd72-8e1a-475a-8d58-1ffa12980966 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.233105 Dec 14 10:12:19.946473 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 321/617] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:19 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:20.962956 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-deff6f47-a1f6-4b61-b13b-c18c1ce321a8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:20.964096 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-deff6f47-a1f6-4b61-b13b-c18c1ce321a8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:20.971236 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-deff6f47-a1f6-4b61-b13b-c18c1ce321a8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:20.971678 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-deff6f47-a1f6-4b61-b13b-c18c1ce321a8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:20.972436 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-deff6f47-a1f6-4b61-b13b-c18c1ce321a8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:20.972867 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-deff6f47-a1f6-4b61-b13b-c18c1ce321a8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:21.170255 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-deff6f47-a1f6-4b61-b13b-c18c1ce321a8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:21.178268 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-deff6f47-a1f6-4b61-b13b-c18c1ce321a8 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.218937 Dec 14 10:12:21.178824 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 297/618] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:20 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:22.195135 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-b7fb9007-8a2e-4838-a03f-6fd482a1a316 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:22.195746 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-b7fb9007-8a2e-4838-a03f-6fd482a1a316 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:22.202932 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b7fb9007-8a2e-4838-a03f-6fd482a1a316 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:22.203378 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b7fb9007-8a2e-4838-a03f-6fd482a1a316 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:22.204145 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b7fb9007-8a2e-4838-a03f-6fd482a1a316 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:22.204588 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b7fb9007-8a2e-4838-a03f-6fd482a1a316 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:22.414044 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-b7fb9007-8a2e-4838-a03f-6fd482a1a316 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:22.424130 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-b7fb9007-8a2e-4838-a03f-6fd482a1a316 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.232549 Dec 14 10:12:22.424785 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 322/619] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:22 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:23.441843 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-21f82e64-199a-464e-8174-b419833b7122 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:23.442625 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-21f82e64-199a-464e-8174-b419833b7122 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:23.450527 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-21f82e64-199a-464e-8174-b419833b7122 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:23.450971 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-21f82e64-199a-464e-8174-b419833b7122 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:23.451735 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-21f82e64-199a-464e-8174-b419833b7122 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:23.452165 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-21f82e64-199a-464e-8174-b419833b7122 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:23.645369 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-21f82e64-199a-464e-8174-b419833b7122 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:23.654640 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-21f82e64-199a-464e-8174-b419833b7122 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.217874 Dec 14 10:12:23.655212 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 298/620] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:23 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:24.671360 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f38fa05d-3376-4f69-a246-bb34754c390e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:24.671893 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f38fa05d-3376-4f69-a246-bb34754c390e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:24.679075 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f38fa05d-3376-4f69-a246-bb34754c390e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:24.679514 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f38fa05d-3376-4f69-a246-bb34754c390e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:24.680271 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f38fa05d-3376-4f69-a246-bb34754c390e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:24.680700 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f38fa05d-3376-4f69-a246-bb34754c390e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:24.877829 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-f38fa05d-3376-4f69-a246-bb34754c390e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:24.886123 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f38fa05d-3376-4f69-a246-bb34754c390e tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.218333 Dec 14 10:12:24.886696 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 323/621] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:24 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:25.904333 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-4351a0f0-3ebc-465a-9924-356b59430e80 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:25.904902 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-4351a0f0-3ebc-465a-9924-356b59430e80 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:25.912140 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4351a0f0-3ebc-465a-9924-356b59430e80 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:25.912588 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4351a0f0-3ebc-465a-9924-356b59430e80 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:25.913353 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4351a0f0-3ebc-465a-9924-356b59430e80 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:25.913785 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4351a0f0-3ebc-465a-9924-356b59430e80 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:26.108953 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-4351a0f0-3ebc-465a-9924-356b59430e80 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:26.117267 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-4351a0f0-3ebc-465a-9924-356b59430e80 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.217595 Dec 14 10:12:26.117826 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 299/622] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:25 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:12:27.136198 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-bf98de66-1b14-43cb-8604-5de9bf9abf11 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:27.136794 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-bf98de66-1b14-43cb-8604-5de9bf9abf11 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:27.144151 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bf98de66-1b14-43cb-8604-5de9bf9abf11 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:27.144595 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bf98de66-1b14-43cb-8604-5de9bf9abf11 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:27.145351 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bf98de66-1b14-43cb-8604-5de9bf9abf11 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:27.145778 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bf98de66-1b14-43cb-8604-5de9bf9abf11 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:27.341220 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-bf98de66-1b14-43cb-8604-5de9bf9abf11 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:27.349371 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-bf98de66-1b14-43cb-8604-5de9bf9abf11 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.217412 Dec 14 10:12:27.349936 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 324/623] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:27 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:28.366680 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-1902a06c-2386-4d7c-92e7-d8343d682465 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:28.367285 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-1902a06c-2386-4d7c-92e7-d8343d682465 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:28.375489 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1902a06c-2386-4d7c-92e7-d8343d682465 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:28.375933 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1902a06c-2386-4d7c-92e7-d8343d682465 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:28.376695 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1902a06c-2386-4d7c-92e7-d8343d682465 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:28.377129 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1902a06c-2386-4d7c-92e7-d8343d682465 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:28.725465 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-a427e3cc-ee54-437b-ad4f-2af7055f6d3a req-96f4dc61-6641-408a-afcf-26205164adc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b4bf45-d284-4fcf-acc0-610f2a7b7dcd", "name": "network-vif-deleted", "tag": "7a526190-4919-4594-99c3-7109b540bd6f"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:12:28.727069 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:12:28.727069 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:12:28.736436 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-a427e3cc-ee54-437b-ad4f-2af7055f6d3a req-96f4dc61-6641-408a-afcf-26205164adc7 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:28.736960 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-a427e3cc-ee54-437b-ad4f-2af7055f6d3a req-96f4dc61-6641-408a-afcf-26205164adc7 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:28.747741 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-1902a06c-2386-4d7c-92e7-d8343d682465 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:28.756421 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-a427e3cc-ee54-437b-ad4f-2af7055f6d3a req-96f4dc61-6641-408a-afcf-26205164adc7 service nova] Creating event network-vif-deleted:7a526190-4919-4594-99c3-7109b540bd6f for instance 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd on hv-cinder-81888 Dec 14 10:12:28.756587 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-1902a06c-2386-4d7c-92e7-d8343d682465 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1521 microversion: 2.1 time: 0.393383 Dec 14 10:12:28.756994 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 300/624] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:28 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:28.761929 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-a427e3cc-ee54-437b-ad4f-2af7055f6d3a req-96f4dc61-6641-408a-afcf-26205164adc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040144 Dec 14 10:12:28.762536 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 325/625] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:12:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:12:29.773819 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6548321a-db86-476f-bad6-a13cfbf49399 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:29.774548 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6548321a-db86-476f-bad6-a13cfbf49399 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:29.782729 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6548321a-db86-476f-bad6-a13cfbf49399 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:29.783171 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6548321a-db86-476f-bad6-a13cfbf49399 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:29.783927 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6548321a-db86-476f-bad6-a13cfbf49399 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:29.784354 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6548321a-db86-476f-bad6-a13cfbf49399 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:29.860730 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6548321a-db86-476f-bad6-a13cfbf49399 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:29.861183 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6548321a-db86-476f-bad6-a13cfbf49399 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:29.861644 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.objects.instance [None req-6548321a-db86-476f-bad6-a13cfbf49399 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lazy-loading 'fault' on Instance uuid 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd {{(pid=100985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:12:29.936971 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-6548321a-db86-476f-bad6-a13cfbf49399 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd42ec3da644dbeb47be466cc1abba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5695583eab44670bb4a5057d81beb15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:29.945010 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6548321a-db86-476f-bad6-a13cfbf49399 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 200 len: 1311 microversion: 2.1 time: 0.174959 Dec 14 10:12:29.945569 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 301/626] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:29 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 1311 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:30.962749 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-835b83dd-595f-4c72-9f9f-f806041d11a7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:30.963516 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-835b83dd-595f-4c72-9f9f-f806041d11a7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] [instance: 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:30.970667 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-835b83dd-595f-4c72-9f9f-f806041d11a7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:30.971111 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-835b83dd-595f-4c72-9f9f-f806041d11a7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:30.971877 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-835b83dd-595f-4c72-9f9f-f806041d11a7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:30.972327 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-835b83dd-595f-4c72-9f9f-f806041d11a7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:31.021338 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-835b83dd-595f-4c72-9f9f-f806041d11a7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] HTTP exception thrown: Instance 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd could not be found. Dec 14 10:12:31.021935 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-835b83dd-595f-4c72-9f9f-f806041d11a7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] Returning 404 to user: Instance 41b4bf45-d284-4fcf-acc0-610f2a7b7dcd could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:12:31.022770 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-835b83dd-595f-4c72-9f9f-f806041d11a7 tempest-ServerRescueNegativeTestJSON-555743256 tempest-ServerRescueNegativeTestJSON-555743256-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd" status: 404 len: 111 microversion: 2.1 time: 0.064537 Dec 14 10:12:31.023518 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 326/627] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:30 2021] GET /compute/v2.1/servers/41b4bf45-d284-4fcf-acc0-610f2a7b7dcd => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:12:32.877269 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-57f4bb9d-c73f-4333-86c3-4d5a42d184fc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:32.877829 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-57f4bb9d-c73f-4333-86c3-4d5a42d184fc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: 4f0deec7-37f0-4eb9-bfa5-85b697768ad6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:32.885789 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-57f4bb9d-c73f-4333-86c3-4d5a42d184fc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:32.886488 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-57f4bb9d-c73f-4333-86c3-4d5a42d184fc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:32.887320 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-57f4bb9d-c73f-4333-86c3-4d5a42d184fc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:32.887821 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-57f4bb9d-c73f-4333-86c3-4d5a42d184fc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:33.043936 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.objects.instance [None req-57f4bb9d-c73f-4333-86c3-4d5a42d184fc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lazy-loading 'services' on Instance uuid 4f0deec7-37f0-4eb9-bfa5-85b697768ad6 {{(pid=100985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:12:33.207028 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-57f4bb9d-c73f-4333-86c3-4d5a42d184fc tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6/os-volume_attachments/440c9ca7-15ca-4b58-a4da-462018766e1f" status: 202 len: 0 microversion: 2.1 time: 0.333311 Dec 14 10:12:33.207611 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 302/628] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Dec 14 10:12:32 2021] DELETE /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6/os-volume_attachments/440c9ca7-15ca-4b58-a4da-462018766e1f => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:12:34.395001 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-49eca455-3569-4000-ba7e-928b4ee77afb tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:34.395585 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-49eca455-3569-4000-ba7e-928b4ee77afb tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: 4f0deec7-37f0-4eb9-bfa5-85b697768ad6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:34.403057 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49eca455-3569-4000-ba7e-928b4ee77afb tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:34.403662 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49eca455-3569-4000-ba7e-928b4ee77afb tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:34.404677 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49eca455-3569-4000-ba7e-928b4ee77afb tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:34.405253 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49eca455-3569-4000-ba7e-928b4ee77afb tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:34.472403 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-49eca455-3569-4000-ba7e-928b4ee77afb tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: 4f0deec7-37f0-4eb9-bfa5-85b697768ad6] Going to try to terminate instance {{(pid=100984) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:12:34.599250 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-49eca455-3569-4000-ba7e-928b4ee77afb tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6" status: 204 len: 0 microversion: 2.1 time: 0.204495 Dec 14 10:12:34.600322 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 327/629] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:12:34 2021] DELETE /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 10:12:34.609518 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-00c940fa-e486-4f64-84e9-8e03f9686a46 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:34.610848 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-00c940fa-e486-4f64-84e9-8e03f9686a46 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: 4f0deec7-37f0-4eb9-bfa5-85b697768ad6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:34.618909 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-00c940fa-e486-4f64-84e9-8e03f9686a46 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:34.619633 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-00c940fa-e486-4f64-84e9-8e03f9686a46 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:34.620625 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-00c940fa-e486-4f64-84e9-8e03f9686a46 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:34.621218 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-00c940fa-e486-4f64-84e9-8e03f9686a46 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:35.097085 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-00c940fa-e486-4f64-84e9-8e03f9686a46 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:35.106633 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-00c940fa-e486-4f64-84e9-8e03f9686a46 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6" status: 200 len: 1513 microversion: 2.1 time: 0.501623 Dec 14 10:12:35.107288 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 303/630] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:34 2021] GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6 => generated 1513 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:36.125907 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e389be39-7db5-4836-9104-e4989cb3d171 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:36.127295 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e389be39-7db5-4836-9104-e4989cb3d171 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: 4f0deec7-37f0-4eb9-bfa5-85b697768ad6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:36.137144 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e389be39-7db5-4836-9104-e4989cb3d171 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:36.137613 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e389be39-7db5-4836-9104-e4989cb3d171 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:36.138815 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e389be39-7db5-4836-9104-e4989cb3d171 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:36.139312 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e389be39-7db5-4836-9104-e4989cb3d171 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:36.368029 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e389be39-7db5-4836-9104-e4989cb3d171 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:36.377321 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e389be39-7db5-4836-9104-e4989cb3d171 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6" status: 200 len: 1513 microversion: 2.1 time: 0.256560 Dec 14 10:12:36.377829 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 328/631] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:36 2021] GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6 => generated 1513 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:37.290623 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-1604ce58-821f-442c-8093-32d203302e0e req-b6f4d6f1-5573-4132-92b1-444d5127b942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0deec7-37f0-4eb9-bfa5-85b697768ad6", "name": "network-vif-deleted", "tag": "8f8c2fb4-5866-4bb0-8bb1-0b8f4f6a5cd0"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:12:37.293076 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:12:37.293076 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:12:37.317507 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-1604ce58-821f-442c-8093-32d203302e0e req-b6f4d6f1-5573-4132-92b1-444d5127b942 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:37.318066 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-1604ce58-821f-442c-8093-32d203302e0e req-b6f4d6f1-5573-4132-92b1-444d5127b942 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:37.344925 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-1604ce58-821f-442c-8093-32d203302e0e req-b6f4d6f1-5573-4132-92b1-444d5127b942 service nova] Creating event network-vif-deleted:8f8c2fb4-5866-4bb0-8bb1-0b8f4f6a5cd0 for instance 4f0deec7-37f0-4eb9-bfa5-85b697768ad6 on hv-cinder-81888 Dec 14 10:12:37.356574 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-1604ce58-821f-442c-8093-32d203302e0e req-b6f4d6f1-5573-4132-92b1-444d5127b942 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072415 Dec 14 10:12:37.357159 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 304/632] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:12:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:12:37.397541 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-bd363aa3-a337-4a8d-8b1a-ba6c1da572ce tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:37.398936 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-bd363aa3-a337-4a8d-8b1a-ba6c1da572ce tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: 4f0deec7-37f0-4eb9-bfa5-85b697768ad6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:37.409444 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bd363aa3-a337-4a8d-8b1a-ba6c1da572ce tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:37.410505 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bd363aa3-a337-4a8d-8b1a-ba6c1da572ce tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:37.411729 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bd363aa3-a337-4a8d-8b1a-ba6c1da572ce tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:37.412375 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bd363aa3-a337-4a8d-8b1a-ba6c1da572ce tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:37.492483 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bd363aa3-a337-4a8d-8b1a-ba6c1da572ce tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:37.493051 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bd363aa3-a337-4a8d-8b1a-ba6c1da572ce tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:37.493583 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.objects.instance [None req-bd363aa3-a337-4a8d-8b1a-ba6c1da572ce tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lazy-loading 'fault' on Instance uuid 4f0deec7-37f0-4eb9-bfa5-85b697768ad6 {{(pid=100984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:12:37.586027 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-bd363aa3-a337-4a8d-8b1a-ba6c1da572ce tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f20a3c734bdebe2197a7cc4d9064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2526870696444f07a95751c539846668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:37.594709 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-bd363aa3-a337-4a8d-8b1a-ba6c1da572ce tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6" status: 200 len: 1308 microversion: 2.1 time: 0.203704 Dec 14 10:12:37.595397 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 329/633] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:37 2021] GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6 => generated 1308 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:38.612900 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-22df561f-ddf4-4aa4-804c-a302aa6ebb85 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:38.613848 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-22df561f-ddf4-4aa4-804c-a302aa6ebb85 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] [instance: 4f0deec7-37f0-4eb9-bfa5-85b697768ad6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:38.621996 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-22df561f-ddf4-4aa4-804c-a302aa6ebb85 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:38.622514 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-22df561f-ddf4-4aa4-804c-a302aa6ebb85 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:38.623442 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-22df561f-ddf4-4aa4-804c-a302aa6ebb85 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:38.623972 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-22df561f-ddf4-4aa4-804c-a302aa6ebb85 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:38.676454 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-22df561f-ddf4-4aa4-804c-a302aa6ebb85 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] HTTP exception thrown: Instance 4f0deec7-37f0-4eb9-bfa5-85b697768ad6 could not be found. Dec 14 10:12:38.676963 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-22df561f-ddf4-4aa4-804c-a302aa6ebb85 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] Returning 404 to user: Instance 4f0deec7-37f0-4eb9-bfa5-85b697768ad6 could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:12:38.677788 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-22df561f-ddf4-4aa4-804c-a302aa6ebb85 tempest-VolumesSnapshotTestJSON-1236209570 tempest-VolumesSnapshotTestJSON-1236209570-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6" status: 404 len: 111 microversion: 2.1 time: 0.069203 Dec 14 10:12:38.678372 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 305/634] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:38 2021] GET /compute/v2.1/servers/4f0deec7-37f0-4eb9-bfa5-85b697768ad6 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:12:43.641934 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4fb06bb5-d324-4cb4-8133-1b9af6f4770d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'create', calling method: .version_select at 0x7fb1791bd5e0>, body: {"keypair": {"name": "tempest-keypair-73314762"}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:12:43.665251 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-4fb06bb5-d324-4cb4-8133-1b9af6f4770d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Getting quotas for project a0c2622fa7624094bfe5a81b02f1bcdd. Resources: {'key_pairs'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:12:43.669750 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-4fb06bb5-d324-4cb4-8133-1b9af6f4770d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Getting quotas for user f659954c79f3426aaaf6612c48a84f1e and project a0c2622fa7624094bfe5a81b02f1bcdd. Resources: {'key_pairs'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:12:43.681014 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4fb06bb5-d324-4cb4-8133-1b9af6f4770d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [ba44dbe9-22ac-4f2b-a76a-c83107f6ae70] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 14 10:12:44.699864 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO oslo.messaging._drivers.impl_rabbit [None req-4fb06bb5-d324-4cb4-8133-1b9af6f4770d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [ba44dbe9-22ac-4f2b-a76a-c83107f6ae70] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46244. Dec 14 10:12:44.934187 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-4fb06bb5-d324-4cb4-8133-1b9af6f4770d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Getting quotas for project a0c2622fa7624094bfe5a81b02f1bcdd. Resources: {'key_pairs'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:12:44.938043 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-4fb06bb5-d324-4cb4-8133-1b9af6f4770d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Getting quotas for user f659954c79f3426aaaf6612c48a84f1e and project a0c2622fa7624094bfe5a81b02f1bcdd. Resources: {'key_pairs'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:12:44.951024 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4fb06bb5-d324-4cb4-8133-1b9af6f4770d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2318 microversion: 2.20 time: 1.469321 Dec 14 10:12:44.951626 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 330/635] 10.222.0.20 () {62 vars in 1198 bytes} [Tue Dec 14 10:12:43 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 1471 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 14 10:12:45.533292 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-5a60b77b-79f8-4f10-9f91-a47348ea8e77 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:12:45.534267 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-5a60b77b-79f8-4f10-9f91-a47348ea8e77 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:45.544066 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5a60b77b-79f8-4f10-9f91-a47348ea8e77 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:45.544697 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5a60b77b-79f8-4f10-9f91-a47348ea8e77 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:45.545489 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5a60b77b-79f8-4f10-9f91-a47348ea8e77 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:45.545921 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5a60b77b-79f8-4f10-9f91-a47348ea8e77 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:45.744771 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-5a60b77b-79f8-4f10-9f91-a47348ea8e77 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "POST /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa/action" status: 202 len: 0 microversion: 2.1 time: 0.214028 Dec 14 10:12:45.746874 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 306/636] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:12:45 2021] POST /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:12:45.755908 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-bfe32f7e-8727-47fb-893c-647f9ad4250e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:45.757364 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-bfe32f7e-8727-47fb-893c-647f9ad4250e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:45.767688 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bfe32f7e-8727-47fb-893c-647f9ad4250e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:45.768491 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bfe32f7e-8727-47fb-893c-647f9ad4250e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:45.769480 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bfe32f7e-8727-47fb-893c-647f9ad4250e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:45.770153 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bfe32f7e-8727-47fb-893c-647f9ad4250e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:46.085054 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-bfe32f7e-8727-47fb-893c-647f9ad4250e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:46.095785 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-bfe32f7e-8727-47fb-893c-647f9ad4250e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1749 microversion: 2.1 time: 0.345006 Dec 14 10:12:46.096866 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 331/637] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:45 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1749 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:47.117784 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6d345204-dfc6-464f-a0f6-ee1e0546d795 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:47.118696 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6d345204-dfc6-464f-a0f6-ee1e0546d795 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:47.127771 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6d345204-dfc6-464f-a0f6-ee1e0546d795 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:47.128535 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6d345204-dfc6-464f-a0f6-ee1e0546d795 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:47.129656 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6d345204-dfc6-464f-a0f6-ee1e0546d795 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:47.130314 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6d345204-dfc6-464f-a0f6-ee1e0546d795 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:47.160089 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a001a5ba-4a4f-4b97-aada-c6b5d18dc520 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1068755237", "imageRef": "5be36fdc-2baa-4efd-b830-5a5c3fd7beba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2fa2a70-4df9-45a3-be45-0c69ddeca040"}], "security_groups": [{"name": "tempest-securitygroup--5991803"}], "key_name": "tempest-keypair-73314762", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:12:47.309738 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.network.neutron [None req-a001a5ba-4a4f-4b97-aada-c6b5d18dc520 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] validate_networks() for [('e2fa2a70-4df9-45a3-be45-0c69ddeca040', None, None, None)] {{(pid=100984) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:12:47.455160 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-6d345204-dfc6-464f-a0f6-ee1e0546d795 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:47.465081 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6d345204-dfc6-464f-a0f6-ee1e0546d795 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1749 microversion: 2.1 time: 0.352872 Dec 14 10:12:47.465933 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 307/638] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:47 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1749 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:47.887792 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-a001a5ba-4a4f-4b97-aada-c6b5d18dc520 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Flavor limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:12:47.888209 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-a001a5ba-4a4f-4b97-aada-c6b5d18dc520 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Image limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:12:47.888684 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-a001a5ba-4a4f-4b97-aada-c6b5d18dc520 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Flavor pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:12:47.889118 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-a001a5ba-4a4f-4b97-aada-c6b5d18dc520 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Image pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:12:47.889525 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-a001a5ba-4a4f-4b97-aada-c6b5d18dc520 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:12:47.897803 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a001a5ba-4a4f-4b97-aada-c6b5d18dc520 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:47.898285 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a001a5ba-4a4f-4b97-aada-c6b5d18dc520 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:47.899071 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a001a5ba-4a4f-4b97-aada-c6b5d18dc520 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:47.899496 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a001a5ba-4a4f-4b97-aada-c6b5d18dc520 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:47.917578 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-a001a5ba-4a4f-4b97-aada-c6b5d18dc520 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Getting quotas for project a0c2622fa7624094bfe5a81b02f1bcdd. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:12:47.921469 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-a001a5ba-4a4f-4b97-aada-c6b5d18dc520 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Getting quotas for user f659954c79f3426aaaf6612c48a84f1e and project a0c2622fa7624094bfe5a81b02f1bcdd. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:12:47.934800 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-a001a5ba-4a4f-4b97-aada-c6b5d18dc520 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Going to run 1 instances... {{(pid=100984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:12:47.937126 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-a001a5ba-4a4f-4b97-aada-c6b5d18dc520 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5be36fdc-2baa-4efd-b830-5a5c3fd7beba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:12:47.981423 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a001a5ba-4a4f-4b97-aada-c6b5d18dc520 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.825654 Dec 14 10:12:47.982296 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 332/639] 10.222.0.20 () {62 vars in 1187 bytes} [Tue Dec 14 10:12:47 2021] POST /compute/v2.1/servers => generated 399 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Dec 14 10:12:47.991989 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-01b30c9a-f812-4d71-b8b9-ff9ce89010ed tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:47.992709 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-01b30c9a-f812-4d71-b8b9-ff9ce89010ed tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:48.084658 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-01b30c9a-f812-4d71-b8b9-ff9ce89010ed tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:48.096007 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-01b30c9a-f812-4d71-b8b9-ff9ce89010ed tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:48.100196 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-01b30c9a-f812-4d71-b8b9-ff9ce89010ed tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:48.102539 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-01b30c9a-f812-4d71-b8b9-ff9ce89010ed tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1280 microversion: 2.20 time: 0.113927 Dec 14 10:12:48.114970 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 308/640] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:12:47 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1280 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:12:48.481440 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1e12a2ae-2a36-4710-86a1-29f2ed4a59e7 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:48.482070 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1e12a2ae-2a36-4710-86a1-29f2ed4a59e7 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:48.489641 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1e12a2ae-2a36-4710-86a1-29f2ed4a59e7 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:48.490117 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1e12a2ae-2a36-4710-86a1-29f2ed4a59e7 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:48.490876 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1e12a2ae-2a36-4710-86a1-29f2ed4a59e7 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:48.491302 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1e12a2ae-2a36-4710-86a1-29f2ed4a59e7 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:48.700122 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1e12a2ae-2a36-4710-86a1-29f2ed4a59e7 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:48.709030 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1e12a2ae-2a36-4710-86a1-29f2ed4a59e7 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1749 microversion: 2.1 time: 0.231237 Dec 14 10:12:48.709527 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 333/641] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:48 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1749 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:49.121603 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3548805e-a01e-44a1-b7a9-5f057e2c88bb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:49.122174 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3548805e-a01e-44a1-b7a9-5f057e2c88bb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:49.130017 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3548805e-a01e-44a1-b7a9-5f057e2c88bb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:49.130462 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3548805e-a01e-44a1-b7a9-5f057e2c88bb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:49.131240 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3548805e-a01e-44a1-b7a9-5f057e2c88bb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:49.131664 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3548805e-a01e-44a1-b7a9-5f057e2c88bb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:49.258699 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3548805e-a01e-44a1-b7a9-5f057e2c88bb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:49.267568 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3548805e-a01e-44a1-b7a9-5f057e2c88bb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:49.269068 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3548805e-a01e-44a1-b7a9-5f057e2c88bb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:49.270247 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3548805e-a01e-44a1-b7a9-5f057e2c88bb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1284 microversion: 2.20 time: 0.153005 Dec 14 10:12:49.270886 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 309/642] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:12:49 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:12:49.398301 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-707c642f-b5a2-4ac8-b0c8-5f1c0620fe9d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:49.398868 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-707c642f-b5a2-4ac8-b0c8-5f1c0620fe9d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:49.406824 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-707c642f-b5a2-4ac8-b0c8-5f1c0620fe9d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:49.407441 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-707c642f-b5a2-4ac8-b0c8-5f1c0620fe9d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:49.408370 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-707c642f-b5a2-4ac8-b0c8-5f1c0620fe9d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:49.408800 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-707c642f-b5a2-4ac8-b0c8-5f1c0620fe9d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:49.560079 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.objects.instance [None req-707c642f-b5a2-4ac8-b0c8-5f1c0620fe9d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lazy-loading 'services' on Instance uuid 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f {{(pid=100984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:12:49.696121 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-707c642f-b5a2-4ac8-b0c8-5f1c0620fe9d tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/os-volume_attachments/38fd60c6-b773-4003-a052-a65574d1604b" status: 202 len: 0 microversion: 2.1 time: 0.301536 Dec 14 10:12:49.699987 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 334/643] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Dec 14 10:12:49 2021] DELETE /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/os-volume_attachments/38fd60c6-b773-4003-a052-a65574d1604b => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:12:49.726497 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6caa6ba4-daa7-4ee6-8819-2fdee9fdabb0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:49.727291 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6caa6ba4-daa7-4ee6-8819-2fdee9fdabb0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:49.735400 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6caa6ba4-daa7-4ee6-8819-2fdee9fdabb0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:49.735919 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6caa6ba4-daa7-4ee6-8819-2fdee9fdabb0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:49.736759 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6caa6ba4-daa7-4ee6-8819-2fdee9fdabb0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:49.737367 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6caa6ba4-daa7-4ee6-8819-2fdee9fdabb0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:49.938702 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-6caa6ba4-daa7-4ee6-8819-2fdee9fdabb0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:49.947066 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6caa6ba4-daa7-4ee6-8819-2fdee9fdabb0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1754 microversion: 2.1 time: 0.224440 Dec 14 10:12:49.947612 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 310/644] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:49 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1754 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:50.288902 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e3624957-57b6-4373-b91f-3e69d7d59bcd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:50.289600 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e3624957-57b6-4373-b91f-3e69d7d59bcd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:50.297096 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e3624957-57b6-4373-b91f-3e69d7d59bcd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:50.297538 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e3624957-57b6-4373-b91f-3e69d7d59bcd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:50.298334 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e3624957-57b6-4373-b91f-3e69d7d59bcd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:50.298769 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e3624957-57b6-4373-b91f-3e69d7d59bcd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:50.412391 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e3624957-57b6-4373-b91f-3e69d7d59bcd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:50.420939 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e3624957-57b6-4373-b91f-3e69d7d59bcd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:50.422460 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e3624957-57b6-4373-b91f-3e69d7d59bcd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:50.423518 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e3624957-57b6-4373-b91f-3e69d7d59bcd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1332 microversion: 2.20 time: 0.138773 Dec 14 10:12:50.424073 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 335/645] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:12:50 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1332 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:12:50.965031 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c9640fb0-01cb-45cd-805f-8aff4de5ada0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:50.965640 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c9640fb0-01cb-45cd-805f-8aff4de5ada0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:50.972663 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c9640fb0-01cb-45cd-805f-8aff4de5ada0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:50.973102 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c9640fb0-01cb-45cd-805f-8aff4de5ada0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:50.973859 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c9640fb0-01cb-45cd-805f-8aff4de5ada0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:50.974314 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c9640fb0-01cb-45cd-805f-8aff4de5ada0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:51.171319 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-c9640fb0-01cb-45cd-805f-8aff4de5ada0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:51.179942 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c9640fb0-01cb-45cd-805f-8aff4de5ada0 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1754 microversion: 2.1 time: 0.219383 Dec 14 10:12:51.180502 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 311/646] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:50 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1754 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:51.442321 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-75c24ad9-d4b5-4509-a9e1-a477a1a1afae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:51.442928 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-75c24ad9-d4b5-4509-a9e1-a477a1a1afae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:51.450199 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-75c24ad9-d4b5-4509-a9e1-a477a1a1afae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:51.450642 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-75c24ad9-d4b5-4509-a9e1-a477a1a1afae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:51.451403 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-75c24ad9-d4b5-4509-a9e1-a477a1a1afae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:51.451835 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-75c24ad9-d4b5-4509-a9e1-a477a1a1afae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:51.561417 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-75c24ad9-d4b5-4509-a9e1-a477a1a1afae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:51.570096 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-75c24ad9-d4b5-4509-a9e1-a477a1a1afae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:51.571675 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-75c24ad9-d4b5-4509-a9e1-a477a1a1afae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:51.573269 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-75c24ad9-d4b5-4509-a9e1-a477a1a1afae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1332 microversion: 2.20 time: 0.134105 Dec 14 10:12:51.574006 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 336/647] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:12:51 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1332 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:12:52.197464 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-32ba3770-b54e-4173-a83b-5567b9a77479 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:52.198361 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-32ba3770-b54e-4173-a83b-5567b9a77479 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:52.205963 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-32ba3770-b54e-4173-a83b-5567b9a77479 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:52.206434 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-32ba3770-b54e-4173-a83b-5567b9a77479 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:52.207238 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-32ba3770-b54e-4173-a83b-5567b9a77479 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:52.207678 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-32ba3770-b54e-4173-a83b-5567b9a77479 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:52.407761 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-32ba3770-b54e-4173-a83b-5567b9a77479 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:52.416682 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-32ba3770-b54e-4173-a83b-5567b9a77479 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1754 microversion: 2.1 time: 0.222934 Dec 14 10:12:52.417609 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 312/648] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:52 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1754 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:52.591551 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5b9e784f-01ff-49af-9730-2d6513cd19d1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:52.592276 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5b9e784f-01ff-49af-9730-2d6513cd19d1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:52.599686 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5b9e784f-01ff-49af-9730-2d6513cd19d1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:52.600197 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5b9e784f-01ff-49af-9730-2d6513cd19d1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:52.601028 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5b9e784f-01ff-49af-9730-2d6513cd19d1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:52.601522 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5b9e784f-01ff-49af-9730-2d6513cd19d1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:52.722785 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5b9e784f-01ff-49af-9730-2d6513cd19d1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:52.732699 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5b9e784f-01ff-49af-9730-2d6513cd19d1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:52.734542 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5b9e784f-01ff-49af-9730-2d6513cd19d1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:52.735718 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5b9e784f-01ff-49af-9730-2d6513cd19d1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1350 microversion: 2.20 time: 0.148125 Dec 14 10:12:52.736406 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 337/649] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:12:52 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:12:53.437030 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-9d05e6e9-62dd-4edb-9523-fc474b2b319d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:53.437872 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-9d05e6e9-62dd-4edb-9523-fc474b2b319d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:53.449287 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9d05e6e9-62dd-4edb-9523-fc474b2b319d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:53.449442 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9d05e6e9-62dd-4edb-9523-fc474b2b319d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:53.450571 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9d05e6e9-62dd-4edb-9523-fc474b2b319d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:53.451719 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9d05e6e9-62dd-4edb-9523-fc474b2b319d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:53.755174 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-849ef5a9-a65b-48c5-af6c-981a3d50f8b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:53.756958 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-849ef5a9-a65b-48c5-af6c-981a3d50f8b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:53.767205 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-849ef5a9-a65b-48c5-af6c-981a3d50f8b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:53.769054 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-849ef5a9-a65b-48c5-af6c-981a3d50f8b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:53.769904 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-849ef5a9-a65b-48c5-af6c-981a3d50f8b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:53.770431 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-849ef5a9-a65b-48c5-af6c-981a3d50f8b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:53.977326 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-849ef5a9-a65b-48c5-af6c-981a3d50f8b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:53.979639 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-9d05e6e9-62dd-4edb-9523-fc474b2b319d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:53.988449 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-849ef5a9-a65b-48c5-af6c-981a3d50f8b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:53.990225 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-9d05e6e9-62dd-4edb-9523-fc474b2b319d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1754 microversion: 2.1 time: 0.559374 Dec 14 10:12:53.991076 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-849ef5a9-a65b-48c5-af6c-981a3d50f8b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:53.992239 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-849ef5a9-a65b-48c5-af6c-981a3d50f8b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1403 microversion: 2.20 time: 0.241647 Dec 14 10:12:54.003584 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 313/650] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:53 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1754 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:54.004841 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 338/651] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:12:53 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1403 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:12:54.137566 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-49afc159-a539-4455-a337-2ac3dc50097b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:12:54.144778 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-49afc159-a539-4455-a337-2ac3dc50097b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:54.145222 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-49afc159-a539-4455-a337-2ac3dc50097b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:54.201191 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-49afc159-a539-4455-a337-2ac3dc50097b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Going to try to stop instance {{(pid=100985) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Dec 14 10:12:54.283185 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-49afc159-a539-4455-a337-2ac3dc50097b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 202 len: 0 microversion: 2.1 time: 0.149117 Dec 14 10:12:54.283803 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 314/652] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:12:54 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:12:54.292713 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-af6405a1-e31d-48dc-b7f7-eddee3c6b04e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:54.293370 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-af6405a1-e31d-48dc-b7f7-eddee3c6b04e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:54.301124 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-af6405a1-e31d-48dc-b7f7-eddee3c6b04e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:54.301913 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-af6405a1-e31d-48dc-b7f7-eddee3c6b04e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:54.302985 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-af6405a1-e31d-48dc-b7f7-eddee3c6b04e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:54.303355 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-af6405a1-e31d-48dc-b7f7-eddee3c6b04e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:54.519300 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-af6405a1-e31d-48dc-b7f7-eddee3c6b04e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:54.531577 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-af6405a1-e31d-48dc-b7f7-eddee3c6b04e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1679 microversion: 2.1 time: 0.243379 Dec 14 10:12:54.532952 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 339/653] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:54 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1679 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:54.672869 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-cbd1d7da-5422-433c-b065-3c993738811b req-c7b1168e-e236-45ac-8fa6-1892f4e09d62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "457d8e04-7e43-4287-8640-efedad40515d", "tag": "07c89ab1-3f66-4963-95e3-1048fc17638b"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:12:54.675170 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:12:54.675170 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:12:54.687184 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-cbd1d7da-5422-433c-b065-3c993738811b req-c7b1168e-e236-45ac-8fa6-1892f4e09d62 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:54.687633 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-cbd1d7da-5422-433c-b065-3c993738811b req-c7b1168e-e236-45ac-8fa6-1892f4e09d62 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:54.709634 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-cbd1d7da-5422-433c-b065-3c993738811b req-c7b1168e-e236-45ac-8fa6-1892f4e09d62 service nova] Creating event network-changed:07c89ab1-3f66-4963-95e3-1048fc17638b for instance 457d8e04-7e43-4287-8640-efedad40515d on hv-cinder-81888 Dec 14 10:12:54.716493 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-cbd1d7da-5422-433c-b065-3c993738811b req-c7b1168e-e236-45ac-8fa6-1892f4e09d62 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071395 Dec 14 10:12:54.717462 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 315/654] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:12:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:12:55.009436 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8b142fd5-b438-4347-ae9f-f8a0cc290ff2 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:55.011268 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-8b142fd5-b438-4347-ae9f-f8a0cc290ff2 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:55.014364 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3d6a5dd3-0168-43d6-886f-d3df416d609b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:55.015121 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3d6a5dd3-0168-43d6-886f-d3df416d609b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:55.021602 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8b142fd5-b438-4347-ae9f-f8a0cc290ff2 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:55.022488 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8b142fd5-b438-4347-ae9f-f8a0cc290ff2 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:55.023664 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8b142fd5-b438-4347-ae9f-f8a0cc290ff2 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:55.023885 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3d6a5dd3-0168-43d6-886f-d3df416d609b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:55.024297 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8b142fd5-b438-4347-ae9f-f8a0cc290ff2 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:55.024417 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3d6a5dd3-0168-43d6-886f-d3df416d609b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:55.025424 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3d6a5dd3-0168-43d6-886f-d3df416d609b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:55.026134 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3d6a5dd3-0168-43d6-886f-d3df416d609b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:55.258326 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-8b142fd5-b438-4347-ae9f-f8a0cc290ff2 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:55.268303 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8b142fd5-b438-4347-ae9f-f8a0cc290ff2 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1754 microversion: 2.1 time: 0.262316 Dec 14 10:12:55.269094 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 340/655] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:55 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1754 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:55.435236 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3d6a5dd3-0168-43d6-886f-d3df416d609b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:55.443874 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3d6a5dd3-0168-43d6-886f-d3df416d609b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:55.445355 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3d6a5dd3-0168-43d6-886f-d3df416d609b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:55.446451 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3d6a5dd3-0168-43d6-886f-d3df416d609b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1403 microversion: 2.20 time: 0.438302 Dec 14 10:12:55.446999 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 316/656] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:12:55 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1403 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:12:55.548328 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-10fbb22f-e14e-4c46-9c37-389da82cb5ef tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:55.548938 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-10fbb22f-e14e-4c46-9c37-389da82cb5ef tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:55.556086 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-10fbb22f-e14e-4c46-9c37-389da82cb5ef tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:55.556527 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-10fbb22f-e14e-4c46-9c37-389da82cb5ef tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:55.557288 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-10fbb22f-e14e-4c46-9c37-389da82cb5ef tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:55.557725 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-10fbb22f-e14e-4c46-9c37-389da82cb5ef tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:55.822354 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-10fbb22f-e14e-4c46-9c37-389da82cb5ef tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:55.830759 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-10fbb22f-e14e-4c46-9c37-389da82cb5ef tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1679 microversion: 2.1 time: 0.286088 Dec 14 10:12:55.831320 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 341/657] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:55 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1679 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:56.285405 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f4b244ad-406c-4756-8bfa-53e7c65c0e04 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:56.286040 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f4b244ad-406c-4756-8bfa-53e7c65c0e04 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:56.293933 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f4b244ad-406c-4756-8bfa-53e7c65c0e04 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:56.294413 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f4b244ad-406c-4756-8bfa-53e7c65c0e04 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:56.295183 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f4b244ad-406c-4756-8bfa-53e7c65c0e04 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:56.295618 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f4b244ad-406c-4756-8bfa-53e7c65c0e04 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:56.467148 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c7d68a98-8d22-438f-b0d9-62ca728d3a37 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:56.468374 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c7d68a98-8d22-438f-b0d9-62ca728d3a37 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:56.476715 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c7d68a98-8d22-438f-b0d9-62ca728d3a37 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:56.477279 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c7d68a98-8d22-438f-b0d9-62ca728d3a37 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:56.478277 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c7d68a98-8d22-438f-b0d9-62ca728d3a37 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:56.478708 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c7d68a98-8d22-438f-b0d9-62ca728d3a37 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:56.495813 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f4b244ad-406c-4756-8bfa-53e7c65c0e04 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:56.504934 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f4b244ad-406c-4756-8bfa-53e7c65c0e04 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1754 microversion: 2.1 time: 0.223200 Dec 14 10:12:56.505496 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 317/658] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:56 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1754 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:56.683765 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c7d68a98-8d22-438f-b0d9-62ca728d3a37 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:56.692279 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c7d68a98-8d22-438f-b0d9-62ca728d3a37 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:56.693776 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c7d68a98-8d22-438f-b0d9-62ca728d3a37 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:56.694875 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c7d68a98-8d22-438f-b0d9-62ca728d3a37 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1403 microversion: 2.20 time: 0.233682 Dec 14 10:12:56.695421 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 342/659] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:12:56 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1403 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:12:56.848352 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-159d3dcb-5d29-44a0-8f4b-7104b8b54bc1 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:56.849004 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-159d3dcb-5d29-44a0-8f4b-7104b8b54bc1 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:56.856359 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-159d3dcb-5d29-44a0-8f4b-7104b8b54bc1 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:56.856792 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-159d3dcb-5d29-44a0-8f4b-7104b8b54bc1 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:56.857542 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-159d3dcb-5d29-44a0-8f4b-7104b8b54bc1 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:56.857979 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-159d3dcb-5d29-44a0-8f4b-7104b8b54bc1 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:57.052895 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-159d3dcb-5d29-44a0-8f4b-7104b8b54bc1 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:57.062031 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-159d3dcb-5d29-44a0-8f4b-7104b8b54bc1 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1679 microversion: 2.1 time: 0.217564 Dec 14 10:12:57.062600 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 318/660] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:56 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1679 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:57.521733 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-038bce49-065c-45d0-b44d-a7e5c63a7d48 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:57.522368 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-038bce49-065c-45d0-b44d-a7e5c63a7d48 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:57.530003 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-038bce49-065c-45d0-b44d-a7e5c63a7d48 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:57.530443 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-038bce49-065c-45d0-b44d-a7e5c63a7d48 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:57.531194 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-038bce49-065c-45d0-b44d-a7e5c63a7d48 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:57.531619 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-038bce49-065c-45d0-b44d-a7e5c63a7d48 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:57.712965 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-89cf66c0-612a-4228-b3e6-3237338f22b1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:57.714739 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-89cf66c0-612a-4228-b3e6-3237338f22b1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:57.722010 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-89cf66c0-612a-4228-b3e6-3237338f22b1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:57.722662 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-89cf66c0-612a-4228-b3e6-3237338f22b1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:57.723512 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-89cf66c0-612a-4228-b3e6-3237338f22b1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:57.723954 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-89cf66c0-612a-4228-b3e6-3237338f22b1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:57.725034 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-038bce49-065c-45d0-b44d-a7e5c63a7d48 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:57.733835 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-038bce49-065c-45d0-b44d-a7e5c63a7d48 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1754 microversion: 2.1 time: 0.215760 Dec 14 10:12:57.734431 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 343/661] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:57 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1754 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:57.924128 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-89cf66c0-612a-4228-b3e6-3237338f22b1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:57.933571 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-89cf66c0-612a-4228-b3e6-3237338f22b1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:57.935089 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-89cf66c0-612a-4228-b3e6-3237338f22b1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:57.936149 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-89cf66c0-612a-4228-b3e6-3237338f22b1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1403 microversion: 2.20 time: 0.227000 Dec 14 10:12:57.936688 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 319/662] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:12:57 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1403 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:12:58.079611 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a0ea3817-37e6-4db7-983f-8559b92f0ec3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:58.080225 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-a0ea3817-37e6-4db7-983f-8559b92f0ec3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:58.087598 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a0ea3817-37e6-4db7-983f-8559b92f0ec3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:58.088047 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a0ea3817-37e6-4db7-983f-8559b92f0ec3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:58.089040 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a0ea3817-37e6-4db7-983f-8559b92f0ec3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:58.089476 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a0ea3817-37e6-4db7-983f-8559b92f0ec3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:58.299236 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-a0ea3817-37e6-4db7-983f-8559b92f0ec3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:58.308249 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a0ea3817-37e6-4db7-983f-8559b92f0ec3 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1679 microversion: 2.1 time: 0.232525 Dec 14 10:12:58.308919 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 344/663] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:58 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1679 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:58.750585 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-da01a96e-4449-4d63-859a-691198cfee7d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:58.751281 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-da01a96e-4449-4d63-859a-691198cfee7d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:58.758715 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-da01a96e-4449-4d63-859a-691198cfee7d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:58.759103 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-da01a96e-4449-4d63-859a-691198cfee7d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:58.759945 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-da01a96e-4449-4d63-859a-691198cfee7d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:58.763273 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-da01a96e-4449-4d63-859a-691198cfee7d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:58.954536 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-89ec9b5f-2c1a-45d4-ad4b-68ac955da8fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:58.955295 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-89ec9b5f-2c1a-45d4-ad4b-68ac955da8fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:58.961464 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-da01a96e-4449-4d63-859a-691198cfee7d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:58.962939 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-89ec9b5f-2c1a-45d4-ad4b-68ac955da8fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:58.964049 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-89ec9b5f-2c1a-45d4-ad4b-68ac955da8fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:58.965106 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-89ec9b5f-2c1a-45d4-ad4b-68ac955da8fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:58.965610 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-89ec9b5f-2c1a-45d4-ad4b-68ac955da8fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:58.971982 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-da01a96e-4449-4d63-859a-691198cfee7d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1754 microversion: 2.1 time: 0.224948 Dec 14 10:12:58.972555 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 320/664] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:58 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1754 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:59.189778 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-89ec9b5f-2c1a-45d4-ad4b-68ac955da8fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:59.198979 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-89ec9b5f-2c1a-45d4-ad4b-68ac955da8fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:59.200575 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-89ec9b5f-2c1a-45d4-ad4b-68ac955da8fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:59.201718 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-89ec9b5f-2c1a-45d4-ad4b-68ac955da8fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1403 microversion: 2.20 time: 0.250994 Dec 14 10:12:59.202394 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 345/665] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:12:58 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1403 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:12:59.324976 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-681d0bcb-d1bf-46f7-8c62-f55e95f0ec88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:59.325558 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-681d0bcb-d1bf-46f7-8c62-f55e95f0ec88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:59.332896 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-681d0bcb-d1bf-46f7-8c62-f55e95f0ec88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:59.333341 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-681d0bcb-d1bf-46f7-8c62-f55e95f0ec88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:59.334128 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-681d0bcb-d1bf-46f7-8c62-f55e95f0ec88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:59.334561 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-681d0bcb-d1bf-46f7-8c62-f55e95f0ec88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:59.532922 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-681d0bcb-d1bf-46f7-8c62-f55e95f0ec88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:12:59.540895 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-681d0bcb-d1bf-46f7-8c62-f55e95f0ec88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1679 microversion: 2.1 time: 0.220115 Dec 14 10:12:59.542268 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 321/666] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:59 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:12:59.988519 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-061db8ce-18c6-47c6-bcf5-a946133b5722 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:12:59.989146 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-061db8ce-18c6-47c6-bcf5-a946133b5722 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:12:59.996350 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-061db8ce-18c6-47c6-bcf5-a946133b5722 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:59.996868 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-061db8ce-18c6-47c6-bcf5-a946133b5722 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:12:59.997699 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-061db8ce-18c6-47c6-bcf5-a946133b5722 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:12:59.998163 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-061db8ce-18c6-47c6-bcf5-a946133b5722 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:00.204473 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-061db8ce-18c6-47c6-bcf5-a946133b5722 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:00.213170 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-061db8ce-18c6-47c6-bcf5-a946133b5722 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1754 microversion: 2.1 time: 0.228305 Dec 14 10:13:00.213735 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 346/667] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:12:59 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1754 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:00.221384 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-45f7bab8-19b6-40a0-8150-a688cb2ccc5f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:00.222170 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-45f7bab8-19b6-40a0-8150-a688cb2ccc5f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:00.229670 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-45f7bab8-19b6-40a0-8150-a688cb2ccc5f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:00.230145 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-45f7bab8-19b6-40a0-8150-a688cb2ccc5f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:00.230920 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-45f7bab8-19b6-40a0-8150-a688cb2ccc5f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:00.231354 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-45f7bab8-19b6-40a0-8150-a688cb2ccc5f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:00.430710 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-45f7bab8-19b6-40a0-8150-a688cb2ccc5f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:00.440500 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-45f7bab8-19b6-40a0-8150-a688cb2ccc5f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:00.442254 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-45f7bab8-19b6-40a0-8150-a688cb2ccc5f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:00.443342 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-45f7bab8-19b6-40a0-8150-a688cb2ccc5f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1403 microversion: 2.20 time: 0.226663 Dec 14 10:13:00.444065 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 322/668] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:13:00 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1403 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:13:00.559668 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1651a345-d7ff-4d33-9ea5-e515774c0c1f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:00.560281 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1651a345-d7ff-4d33-9ea5-e515774c0c1f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:00.567482 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1651a345-d7ff-4d33-9ea5-e515774c0c1f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:00.568113 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1651a345-d7ff-4d33-9ea5-e515774c0c1f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:00.569062 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1651a345-d7ff-4d33-9ea5-e515774c0c1f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:00.569651 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1651a345-d7ff-4d33-9ea5-e515774c0c1f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:00.772002 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1651a345-d7ff-4d33-9ea5-e515774c0c1f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:00.781455 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1651a345-d7ff-4d33-9ea5-e515774c0c1f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1679 microversion: 2.1 time: 0.226028 Dec 14 10:13:00.782211 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 347/669] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:00 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1679 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:01.230296 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-80a102de-af1e-431d-9d5b-df722056f9e5 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:01.230906 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-80a102de-af1e-431d-9d5b-df722056f9e5 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:01.238129 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-80a102de-af1e-431d-9d5b-df722056f9e5 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:01.238574 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-80a102de-af1e-431d-9d5b-df722056f9e5 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:01.239331 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-80a102de-af1e-431d-9d5b-df722056f9e5 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:01.239754 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-80a102de-af1e-431d-9d5b-df722056f9e5 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:01.434822 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-80a102de-af1e-431d-9d5b-df722056f9e5 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:01.443324 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-80a102de-af1e-431d-9d5b-df722056f9e5 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1754 microversion: 2.1 time: 0.216969 Dec 14 10:13:01.443964 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 323/670] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:01 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1754 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:01.461454 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-37b0b000-a7c5-44b7-9310-7f4285ba2355 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:01.462078 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-37b0b000-a7c5-44b7-9310-7f4285ba2355 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:01.469783 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-37b0b000-a7c5-44b7-9310-7f4285ba2355 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:01.470294 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-37b0b000-a7c5-44b7-9310-7f4285ba2355 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:01.471057 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-37b0b000-a7c5-44b7-9310-7f4285ba2355 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:01.471489 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-37b0b000-a7c5-44b7-9310-7f4285ba2355 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:01.664855 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-37b0b000-a7c5-44b7-9310-7f4285ba2355 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:01.674537 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-37b0b000-a7c5-44b7-9310-7f4285ba2355 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:01.676071 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-37b0b000-a7c5-44b7-9310-7f4285ba2355 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:01.677140 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-37b0b000-a7c5-44b7-9310-7f4285ba2355 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1403 microversion: 2.20 time: 0.219438 Dec 14 10:13:01.677811 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 348/671] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:13:01 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1403 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:13:01.799427 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-4a2d85e6-65cc-40ce-aa5b-d85ab67aebee tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:01.800053 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-4a2d85e6-65cc-40ce-aa5b-d85ab67aebee tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:01.807792 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4a2d85e6-65cc-40ce-aa5b-d85ab67aebee tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:01.808349 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4a2d85e6-65cc-40ce-aa5b-d85ab67aebee tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:01.809124 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4a2d85e6-65cc-40ce-aa5b-d85ab67aebee tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:01.809563 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4a2d85e6-65cc-40ce-aa5b-d85ab67aebee tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:02.120545 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-4a2d85e6-65cc-40ce-aa5b-d85ab67aebee tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:02.130478 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-4a2d85e6-65cc-40ce-aa5b-d85ab67aebee tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1679 microversion: 2.1 time: 0.334764 Dec 14 10:13:02.131329 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 324/672] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:01 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1679 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:02.461049 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f13a773a-b2ff-4ad3-bee0-0f635aa7112d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:02.461677 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f13a773a-b2ff-4ad3-bee0-0f635aa7112d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:02.469687 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f13a773a-b2ff-4ad3-bee0-0f635aa7112d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:02.470176 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f13a773a-b2ff-4ad3-bee0-0f635aa7112d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:02.470944 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f13a773a-b2ff-4ad3-bee0-0f635aa7112d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:02.471367 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f13a773a-b2ff-4ad3-bee0-0f635aa7112d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:02.668354 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-f13a773a-b2ff-4ad3-bee0-0f635aa7112d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:02.676762 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f13a773a-b2ff-4ad3-bee0-0f635aa7112d tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1754 microversion: 2.1 time: 0.219418 Dec 14 10:13:02.677322 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 349/673] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:02 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1754 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:02.695377 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-88c69bb7-8412-4ac0-b2f9-81d35ac7c7b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:02.695986 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-88c69bb7-8412-4ac0-b2f9-81d35ac7c7b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:02.703624 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-88c69bb7-8412-4ac0-b2f9-81d35ac7c7b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:02.704070 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-88c69bb7-8412-4ac0-b2f9-81d35ac7c7b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:02.704841 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-88c69bb7-8412-4ac0-b2f9-81d35ac7c7b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:02.705277 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-88c69bb7-8412-4ac0-b2f9-81d35ac7c7b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:02.897710 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-88c69bb7-8412-4ac0-b2f9-81d35ac7c7b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:02.907352 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-88c69bb7-8412-4ac0-b2f9-81d35ac7c7b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:02.909132 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-88c69bb7-8412-4ac0-b2f9-81d35ac7c7b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:02.910347 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-88c69bb7-8412-4ac0-b2f9-81d35ac7c7b3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1403 microversion: 2.20 time: 0.218539 Dec 14 10:13:02.910902 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 325/674] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:13:02 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1403 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:13:03.147597 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-73cc8d31-0779-4546-aac1-77434235c27f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:03.148128 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-73cc8d31-0779-4546-aac1-77434235c27f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:03.155742 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73cc8d31-0779-4546-aac1-77434235c27f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:03.156176 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73cc8d31-0779-4546-aac1-77434235c27f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:03.156926 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73cc8d31-0779-4546-aac1-77434235c27f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:03.157345 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73cc8d31-0779-4546-aac1-77434235c27f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:03.351994 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-73cc8d31-0779-4546-aac1-77434235c27f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:03.360097 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-73cc8d31-0779-4546-aac1-77434235c27f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1679 microversion: 2.1 time: 0.216265 Dec 14 10:13:03.360651 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 350/675] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:03 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1679 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:03.693850 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-171aa4ca-b102-43d5-b751-5dfeb0ca498a tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:03.694485 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-171aa4ca-b102-43d5-b751-5dfeb0ca498a tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:03.701824 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-171aa4ca-b102-43d5-b751-5dfeb0ca498a tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:03.702422 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-171aa4ca-b102-43d5-b751-5dfeb0ca498a tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:03.703044 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-171aa4ca-b102-43d5-b751-5dfeb0ca498a tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:03.703471 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-171aa4ca-b102-43d5-b751-5dfeb0ca498a tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:03.900381 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-171aa4ca-b102-43d5-b751-5dfeb0ca498a tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:03.909841 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-171aa4ca-b102-43d5-b751-5dfeb0ca498a tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1754 microversion: 2.1 time: 0.219699 Dec 14 10:13:03.910432 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 326/676] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:03 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1754 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:03.928509 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e420924e-5948-4600-88b7-26eab3c5d6b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:03.929411 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e420924e-5948-4600-88b7-26eab3c5d6b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:03.936571 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e420924e-5948-4600-88b7-26eab3c5d6b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:03.936810 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e420924e-5948-4600-88b7-26eab3c5d6b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:03.937564 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e420924e-5948-4600-88b7-26eab3c5d6b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:03.938017 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e420924e-5948-4600-88b7-26eab3c5d6b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:04.134050 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e420924e-5948-4600-88b7-26eab3c5d6b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:04.143244 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e420924e-5948-4600-88b7-26eab3c5d6b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:04.144743 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e420924e-5948-4600-88b7-26eab3c5d6b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:04.145809 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e420924e-5948-4600-88b7-26eab3c5d6b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1403 microversion: 2.20 time: 0.221198 Dec 14 10:13:04.146406 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 351/677] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:13:03 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1403 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:13:04.377533 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a54fce6a-0df6-4828-9e43-9790ea42a65a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:04.378183 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a54fce6a-0df6-4828-9e43-9790ea42a65a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:04.385724 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a54fce6a-0df6-4828-9e43-9790ea42a65a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:04.386189 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a54fce6a-0df6-4828-9e43-9790ea42a65a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:04.386947 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a54fce6a-0df6-4828-9e43-9790ea42a65a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:04.387372 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a54fce6a-0df6-4828-9e43-9790ea42a65a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:04.579780 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-a54fce6a-0df6-4828-9e43-9790ea42a65a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:04.588052 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a54fce6a-0df6-4828-9e43-9790ea42a65a tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1679 microversion: 2.1 time: 0.214380 Dec 14 10:13:04.588623 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 327/678] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:04 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1679 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:04.926786 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c3fbb6a3-0047-4100-b5f2-027694e9f4de tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:04.927318 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c3fbb6a3-0047-4100-b5f2-027694e9f4de tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:04.935293 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c3fbb6a3-0047-4100-b5f2-027694e9f4de tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:04.935870 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c3fbb6a3-0047-4100-b5f2-027694e9f4de tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:04.936479 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c3fbb6a3-0047-4100-b5f2-027694e9f4de tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:04.936910 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c3fbb6a3-0047-4100-b5f2-027694e9f4de tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:05.133916 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c3fbb6a3-0047-4100-b5f2-027694e9f4de tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:05.142890 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c3fbb6a3-0047-4100-b5f2-027694e9f4de tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1754 microversion: 2.1 time: 0.219834 Dec 14 10:13:05.143449 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 352/679] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:04 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1754 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:05.164226 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-5798c269-7e2f-42b6-a2c3-0801c87d9485 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:05.164839 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-5798c269-7e2f-42b6-a2c3-0801c87d9485 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:05.172447 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5798c269-7e2f-42b6-a2c3-0801c87d9485 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:05.172893 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5798c269-7e2f-42b6-a2c3-0801c87d9485 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:05.173664 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5798c269-7e2f-42b6-a2c3-0801c87d9485 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:05.174150 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5798c269-7e2f-42b6-a2c3-0801c87d9485 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:05.371802 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-5798c269-7e2f-42b6-a2c3-0801c87d9485 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:05.380907 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-5798c269-7e2f-42b6-a2c3-0801c87d9485 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:05.382439 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-5798c269-7e2f-42b6-a2c3-0801c87d9485 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:05.383514 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-5798c269-7e2f-42b6-a2c3-0801c87d9485 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1403 microversion: 2.20 time: 0.222923 Dec 14 10:13:05.384070 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 328/680] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:13:05 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1403 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:13:05.605806 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-b8506873-9016-4318-9adc-dfa803e1267f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:05.606343 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-b8506873-9016-4318-9adc-dfa803e1267f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:05.614591 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b8506873-9016-4318-9adc-dfa803e1267f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:05.615196 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b8506873-9016-4318-9adc-dfa803e1267f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:05.615968 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b8506873-9016-4318-9adc-dfa803e1267f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:05.616394 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b8506873-9016-4318-9adc-dfa803e1267f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:05.819235 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-b8506873-9016-4318-9adc-dfa803e1267f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:05.827862 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-b8506873-9016-4318-9adc-dfa803e1267f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1679 microversion: 2.1 time: 0.227015 Dec 14 10:13:05.828418 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 353/681] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:05 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1679 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:06.160689 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-fdfa1cfa-4386-4d53-b06b-6d634789820e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:06.161436 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-fdfa1cfa-4386-4d53-b06b-6d634789820e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:06.169712 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fdfa1cfa-4386-4d53-b06b-6d634789820e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:06.170339 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fdfa1cfa-4386-4d53-b06b-6d634789820e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:06.171091 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fdfa1cfa-4386-4d53-b06b-6d634789820e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:06.171597 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fdfa1cfa-4386-4d53-b06b-6d634789820e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:06.377157 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-fdfa1cfa-4386-4d53-b06b-6d634789820e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:06.387072 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-fdfa1cfa-4386-4d53-b06b-6d634789820e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1754 microversion: 2.1 time: 0.230884 Dec 14 10:13:06.387638 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 329/682] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:06 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1754 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:06.400697 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-3823e25f-60bb-494d-bc92-a84d62be413f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:06.401299 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-3823e25f-60bb-494d-bc92-a84d62be413f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:06.408760 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3823e25f-60bb-494d-bc92-a84d62be413f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:06.409373 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3823e25f-60bb-494d-bc92-a84d62be413f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:06.410318 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3823e25f-60bb-494d-bc92-a84d62be413f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:06.410847 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3823e25f-60bb-494d-bc92-a84d62be413f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:06.758217 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-3823e25f-60bb-494d-bc92-a84d62be413f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:06.766827 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-3823e25f-60bb-494d-bc92-a84d62be413f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:06.768293 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-3823e25f-60bb-494d-bc92-a84d62be413f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:06.769351 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-3823e25f-60bb-494d-bc92-a84d62be413f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1403 microversion: 2.20 time: 0.372721 Dec 14 10:13:06.769893 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 354/683] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:13:06 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1403 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:13:06.845023 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f6ffb6e8-491f-4ca0-88f0-8d41fadfa5b9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:06.845560 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f6ffb6e8-491f-4ca0-88f0-8d41fadfa5b9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:06.852639 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f6ffb6e8-491f-4ca0-88f0-8d41fadfa5b9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:06.853182 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f6ffb6e8-491f-4ca0-88f0-8d41fadfa5b9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:06.854867 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f6ffb6e8-491f-4ca0-88f0-8d41fadfa5b9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:06.855316 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f6ffb6e8-491f-4ca0-88f0-8d41fadfa5b9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:07.046474 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f6ffb6e8-491f-4ca0-88f0-8d41fadfa5b9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:07.054601 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f6ffb6e8-491f-4ca0-88f0-8d41fadfa5b9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1679 microversion: 2.1 time: 0.213271 Dec 14 10:13:07.055168 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 330/684] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:06 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1679 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:07.404838 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-14725f9b-24b1-4e6a-aa3c-172028b738eb tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:07.405477 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-14725f9b-24b1-4e6a-aa3c-172028b738eb tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:07.412619 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-14725f9b-24b1-4e6a-aa3c-172028b738eb tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:07.413054 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-14725f9b-24b1-4e6a-aa3c-172028b738eb tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:07.413808 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-14725f9b-24b1-4e6a-aa3c-172028b738eb tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:07.414256 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-14725f9b-24b1-4e6a-aa3c-172028b738eb tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:07.616903 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-14725f9b-24b1-4e6a-aa3c-172028b738eb tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:07.626407 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-14725f9b-24b1-4e6a-aa3c-172028b738eb tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1754 microversion: 2.1 time: 0.225630 Dec 14 10:13:07.627083 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 355/685] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:07 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1754 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:07.787137 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-adf487f5-d58c-42dd-9273-cfab69173457 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:07.787739 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-adf487f5-d58c-42dd-9273-cfab69173457 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:07.795482 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-adf487f5-d58c-42dd-9273-cfab69173457 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:07.796161 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-adf487f5-d58c-42dd-9273-cfab69173457 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:07.796959 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-adf487f5-d58c-42dd-9273-cfab69173457 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:07.797395 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-adf487f5-d58c-42dd-9273-cfab69173457 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:08.007087 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-adf487f5-d58c-42dd-9273-cfab69173457 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:08.016570 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-adf487f5-d58c-42dd-9273-cfab69173457 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:08.018151 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-adf487f5-d58c-42dd-9273-cfab69173457 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:08.019432 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-adf487f5-d58c-42dd-9273-cfab69173457 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1403 microversion: 2.20 time: 0.235970 Dec 14 10:13:08.020286 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 331/686] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:13:07 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1403 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:13:08.073592 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4b766560-4dee-4ac4-af57-6c566bd88e40 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:08.074223 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4b766560-4dee-4ac4-af57-6c566bd88e40 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:08.081899 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4b766560-4dee-4ac4-af57-6c566bd88e40 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:08.082635 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4b766560-4dee-4ac4-af57-6c566bd88e40 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:08.083510 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4b766560-4dee-4ac4-af57-6c566bd88e40 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:08.083946 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4b766560-4dee-4ac4-af57-6c566bd88e40 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:08.134082 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-fbbbbf47-ecf7-4617-9550-d2ed2d3c207d req-ac020409-8b0c-40b1-a13f-2e4a237a4bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "457d8e04-7e43-4287-8640-efedad40515d", "name": "network-vif-plugged", "status": "completed", "tag": "07c89ab1-3f66-4963-95e3-1048fc17638b"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:08.136483 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:13:08.136483 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:13:08.146813 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-fbbbbf47-ecf7-4617-9550-d2ed2d3c207d req-ac020409-8b0c-40b1-a13f-2e4a237a4bc4 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:08.147552 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-fbbbbf47-ecf7-4617-9550-d2ed2d3c207d req-ac020409-8b0c-40b1-a13f-2e4a237a4bc4 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:08.187182 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-fbbbbf47-ecf7-4617-9550-d2ed2d3c207d req-ac020409-8b0c-40b1-a13f-2e4a237a4bc4 service nova] Creating event network-vif-plugged:07c89ab1-3f66-4963-95e3-1048fc17638b for instance 457d8e04-7e43-4287-8640-efedad40515d on hv-cinder-81888 Dec 14 10:13:08.193171 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-fbbbbf47-ecf7-4617-9550-d2ed2d3c207d req-ac020409-8b0c-40b1-a13f-2e4a237a4bc4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063948 Dec 14 10:13:08.193850 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 332/687] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:13:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:13:08.301446 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4b766560-4dee-4ac4-af57-6c566bd88e40 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:08.309634 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4b766560-4dee-4ac4-af57-6c566bd88e40 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1679 microversion: 2.1 time: 0.240755 Dec 14 10:13:08.310222 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 356/688] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:08 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1679 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:08.644423 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-20619485-2b2a-4469-84ce-98c187a024a4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:08.645121 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-20619485-2b2a-4469-84ce-98c187a024a4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:08.653488 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-20619485-2b2a-4469-84ce-98c187a024a4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:08.653938 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-20619485-2b2a-4469-84ce-98c187a024a4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:08.654738 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-20619485-2b2a-4469-84ce-98c187a024a4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:08.655172 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-20619485-2b2a-4469-84ce-98c187a024a4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:08.856721 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-20619485-2b2a-4469-84ce-98c187a024a4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:08.865674 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-20619485-2b2a-4469-84ce-98c187a024a4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1754 microversion: 2.1 time: 0.225424 Dec 14 10:13:08.866452 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 333/689] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:08 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1754 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:09.037720 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5a2e42e1-3dea-4981-9368-5e72dfa52846 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:09.039149 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5a2e42e1-3dea-4981-9368-5e72dfa52846 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:09.047321 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5a2e42e1-3dea-4981-9368-5e72dfa52846 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:09.048047 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5a2e42e1-3dea-4981-9368-5e72dfa52846 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:09.049060 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5a2e42e1-3dea-4981-9368-5e72dfa52846 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:09.049699 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5a2e42e1-3dea-4981-9368-5e72dfa52846 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:09.254120 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5a2e42e1-3dea-4981-9368-5e72dfa52846 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:09.263933 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5a2e42e1-3dea-4981-9368-5e72dfa52846 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:09.265445 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5a2e42e1-3dea-4981-9368-5e72dfa52846 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:09.266660 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5a2e42e1-3dea-4981-9368-5e72dfa52846 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1403 microversion: 2.20 time: 0.232651 Dec 14 10:13:09.267270 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 357/690] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:13:09 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1403 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:13:09.326918 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-58710aa9-2417-4823-a4fb-7dacbae08d0e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:09.327605 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-58710aa9-2417-4823-a4fb-7dacbae08d0e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:09.334870 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-58710aa9-2417-4823-a4fb-7dacbae08d0e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:09.335402 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-58710aa9-2417-4823-a4fb-7dacbae08d0e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:09.336230 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-58710aa9-2417-4823-a4fb-7dacbae08d0e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:09.336729 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-58710aa9-2417-4823-a4fb-7dacbae08d0e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:09.540545 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-58710aa9-2417-4823-a4fb-7dacbae08d0e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:09.549179 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-58710aa9-2417-4823-a4fb-7dacbae08d0e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1679 microversion: 2.1 time: 0.225884 Dec 14 10:13:09.549737 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 334/691] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:09 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1679 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:09.886370 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-9cbb40ce-a703-4264-85a7-8d4f3271a117 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:09.886934 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-9cbb40ce-a703-4264-85a7-8d4f3271a117 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:09.894046 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9cbb40ce-a703-4264-85a7-8d4f3271a117 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:09.894506 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9cbb40ce-a703-4264-85a7-8d4f3271a117 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:09.895282 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9cbb40ce-a703-4264-85a7-8d4f3271a117 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:09.895741 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9cbb40ce-a703-4264-85a7-8d4f3271a117 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:10.203551 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-9cbb40ce-a703-4264-85a7-8d4f3271a117 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:10.216307 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-9cbb40ce-a703-4264-85a7-8d4f3271a117 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1757 microversion: 2.1 time: 0.333635 Dec 14 10:13:10.217909 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 358/692] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:09 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1757 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:10.287035 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-adc57a52-825c-4e44-bc2d-2925209942bd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:10.287648 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-adc57a52-825c-4e44-bc2d-2925209942bd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:10.295621 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-adc57a52-825c-4e44-bc2d-2925209942bd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:10.296335 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-adc57a52-825c-4e44-bc2d-2925209942bd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:10.297346 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-adc57a52-825c-4e44-bc2d-2925209942bd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:10.298213 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-adc57a52-825c-4e44-bc2d-2925209942bd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:10.534232 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-adc57a52-825c-4e44-bc2d-2925209942bd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:10.544722 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-adc57a52-825c-4e44-bc2d-2925209942bd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:10.546355 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-adc57a52-825c-4e44-bc2d-2925209942bd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:10.547563 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-adc57a52-825c-4e44-bc2d-2925209942bd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1595 microversion: 2.20 time: 0.266848 Dec 14 10:13:10.548199 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 335/693] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:13:10 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1595 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:13:10.567084 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-11779423-26d7-443a-9621-15c279146f77 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:10.567819 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-8d4aed73-fb17-48e5-b406-a2f5ab05302e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:10.568063 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-11779423-26d7-443a-9621-15c279146f77 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:10.570043 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-8d4aed73-fb17-48e5-b406-a2f5ab05302e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:10.576196 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-11779423-26d7-443a-9621-15c279146f77 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:10.576951 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-11779423-26d7-443a-9621-15c279146f77 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:10.577946 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-11779423-26d7-443a-9621-15c279146f77 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:10.578592 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-11779423-26d7-443a-9621-15c279146f77 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:10.585641 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8d4aed73-fb17-48e5-b406-a2f5ab05302e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:10.586209 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8d4aed73-fb17-48e5-b406-a2f5ab05302e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:10.587179 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8d4aed73-fb17-48e5-b406-a2f5ab05302e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:10.588390 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8d4aed73-fb17-48e5-b406-a2f5ab05302e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:10.832416 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-8d4aed73-fb17-48e5-b406-a2f5ab05302e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:10.841310 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-8d4aed73-fb17-48e5-b406-a2f5ab05302e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1656 microversion: 2.1 time: 0.277762 Dec 14 10:13:10.842210 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 336/694] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:10 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1656 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:10.858426 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-1a3d770e-8a74-46e9-8560-ccb58e2d4c76 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:10.865558 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1a3d770e-8a74-46e9-8560-ccb58e2d4c76 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:10.866281 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1a3d770e-8a74-46e9-8560-ccb58e2d4c76 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:10.930179 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-1a3d770e-8a74-46e9-8560-ccb58e2d4c76 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Going to try to start instance {{(pid=100985) start /opt/stack/nova/nova/compute/api.py:2625}} Dec 14 10:13:11.012588 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-1a3d770e-8a74-46e9-8560-ccb58e2d4c76 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action" status: 202 len: 0 microversion: 2.1 time: 0.158314 Dec 14 10:13:11.013719 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 337/695] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:13:10 2021] POST /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:11.022719 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3f988cb4-db61-4a4d-9566-66ee37179e0b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:11.023710 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3f988cb4-db61-4a4d-9566-66ee37179e0b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:11.031995 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3f988cb4-db61-4a4d-9566-66ee37179e0b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:11.032611 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3f988cb4-db61-4a4d-9566-66ee37179e0b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:11.033760 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3f988cb4-db61-4a4d-9566-66ee37179e0b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:11.034371 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3f988cb4-db61-4a4d-9566-66ee37179e0b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:11.036687 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-11779423-26d7-443a-9621-15c279146f77 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.473633 Dec 14 10:13:11.037649 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 359/696] 10.222.0.20 () {60 vars in 1315 bytes} [Tue Dec 14 10:13:10 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/os-interface => generated 285 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:13:11.602911 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3f988cb4-db61-4a4d-9566-66ee37179e0b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:11.617012 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3f988cb4-db61-4a4d-9566-66ee37179e0b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1665 microversion: 2.1 time: 0.598279 Dec 14 10:13:11.617875 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 338/697] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:11 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1665 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:13:12.636586 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-918685f6-d662-4ad9-8574-d2324a158692 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:12.637185 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-918685f6-d662-4ad9-8574-d2324a158692 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:12.644652 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-918685f6-d662-4ad9-8574-d2324a158692 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:12.645094 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-918685f6-d662-4ad9-8574-d2324a158692 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:12.645882 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-918685f6-d662-4ad9-8574-d2324a158692 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:12.646343 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-918685f6-d662-4ad9-8574-d2324a158692 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:12.882833 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c31febe0-b860-45d8-9b67-300494261b1f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:12.883785 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c31febe0-b860-45d8-9b67-300494261b1f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:12.892652 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c31febe0-b860-45d8-9b67-300494261b1f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:12.893168 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c31febe0-b860-45d8-9b67-300494261b1f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:12.894199 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c31febe0-b860-45d8-9b67-300494261b1f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:12.895545 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c31febe0-b860-45d8-9b67-300494261b1f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:12.962284 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-918685f6-d662-4ad9-8574-d2324a158692 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:12.972702 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-918685f6-d662-4ad9-8574-d2324a158692 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1665 microversion: 2.1 time: 0.339895 Dec 14 10:13:12.984379 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 360/698] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:12 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1665 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:12.991414 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-d039fb5d-89ce-4b5b-8355-d6d592a8339b req-a6dfc37a-ee11-4116-9fc1-d96656f32964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "457d8e04-7e43-4287-8640-efedad40515d", "tag": "07c89ab1-3f66-4963-95e3-1048fc17638b"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:12.993384 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:13:12.993384 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:13:13.002482 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-d039fb5d-89ce-4b5b-8355-d6d592a8339b req-a6dfc37a-ee11-4116-9fc1-d96656f32964 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:13.003311 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-d039fb5d-89ce-4b5b-8355-d6d592a8339b req-a6dfc37a-ee11-4116-9fc1-d96656f32964 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:13.018030 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c31febe0-b860-45d8-9b67-300494261b1f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 14 microversion: 2.20 time: 0.138505 Dec 14 10:13:13.019527 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 339/699] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:12 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:13:13.027073 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-d039fb5d-89ce-4b5b-8355-d6d592a8339b req-a6dfc37a-ee11-4116-9fc1-d96656f32964 service nova] Creating event network-changed:07c89ab1-3f66-4963-95e3-1048fc17638b for instance 457d8e04-7e43-4287-8640-efedad40515d on hv-cinder-81888 Dec 14 10:13:13.043871 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-d039fb5d-89ce-4b5b-8355-d6d592a8339b req-a6dfc37a-ee11-4116-9fc1-d96656f32964 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057230 Dec 14 10:13:13.046591 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 361/700] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:13:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:13:13.998473 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f7942848-93da-439d-bb55-ea3671946f81 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:14.001419 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f7942848-93da-439d-bb55-ea3671946f81 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:14.032733 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-9555fade-6559-4156-ad85-f71ed2db6dd9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:14.034538 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-9555fade-6559-4156-ad85-f71ed2db6dd9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:14.036095 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f7942848-93da-439d-bb55-ea3671946f81 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:14.036555 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f7942848-93da-439d-bb55-ea3671946f81 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:14.043469 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f7942848-93da-439d-bb55-ea3671946f81 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:14.045633 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f7942848-93da-439d-bb55-ea3671946f81 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:14.045902 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9555fade-6559-4156-ad85-f71ed2db6dd9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:14.046608 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9555fade-6559-4156-ad85-f71ed2db6dd9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:14.048549 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9555fade-6559-4156-ad85-f71ed2db6dd9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:14.049828 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9555fade-6559-4156-ad85-f71ed2db6dd9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:14.186641 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-9555fade-6559-4156-ad85-f71ed2db6dd9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 14 microversion: 2.20 time: 0.161390 Dec 14 10:13:14.188185 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 362/701] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:14 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:13:14.348724 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f7942848-93da-439d-bb55-ea3671946f81 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:14.358852 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f7942848-93da-439d-bb55-ea3671946f81 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1669 microversion: 2.1 time: 0.368777 Dec 14 10:13:14.371748 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 340/702] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:13 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1669 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:15.206268 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-6f9d1ca8-3dd8-4bd1-8c41-238360c62e7d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:15.207763 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-6f9d1ca8-3dd8-4bd1-8c41-238360c62e7d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:15.224827 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6f9d1ca8-3dd8-4bd1-8c41-238360c62e7d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:15.225804 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6f9d1ca8-3dd8-4bd1-8c41-238360c62e7d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:15.229891 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6f9d1ca8-3dd8-4bd1-8c41-238360c62e7d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:15.230584 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6f9d1ca8-3dd8-4bd1-8c41-238360c62e7d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:15.341182 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-6f9d1ca8-3dd8-4bd1-8c41-238360c62e7d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 14 microversion: 2.20 time: 0.146486 Dec 14 10:13:15.341809 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 363/703] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:15 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:16.352141 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-8a2ca779-916f-4180-bc87-58467a9796de tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:16.354540 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-8a2ca779-916f-4180-bc87-58467a9796de tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:16.362898 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8a2ca779-916f-4180-bc87-58467a9796de tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:16.363349 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8a2ca779-916f-4180-bc87-58467a9796de tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:16.364115 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8a2ca779-916f-4180-bc87-58467a9796de tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:16.364690 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8a2ca779-916f-4180-bc87-58467a9796de tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:16.633804 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-8a2ca779-916f-4180-bc87-58467a9796de tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 14 microversion: 2.20 time: 0.285108 Dec 14 10:13:16.635075 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 341/704] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:16 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 14 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:13:17.646092 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-11d36daa-4cbe-4527-ac7d-71d4aaa98a5d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:17.647124 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-11d36daa-4cbe-4527-ac7d-71d4aaa98a5d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:17.656009 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-11d36daa-4cbe-4527-ac7d-71d4aaa98a5d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:17.656668 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-11d36daa-4cbe-4527-ac7d-71d4aaa98a5d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:17.657831 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-11d36daa-4cbe-4527-ac7d-71d4aaa98a5d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:17.658427 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-11d36daa-4cbe-4527-ac7d-71d4aaa98a5d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:17.787822 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-11d36daa-4cbe-4527-ac7d-71d4aaa98a5d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 14 microversion: 2.20 time: 0.145352 Dec 14 10:13:17.788852 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 364/705] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:17 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:18.817341 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-466e29f3-315c-496a-9c56-26b003d00c1d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:18.825762 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-466e29f3-315c-496a-9c56-26b003d00c1d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:18.848268 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-466e29f3-315c-496a-9c56-26b003d00c1d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:18.852294 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-466e29f3-315c-496a-9c56-26b003d00c1d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:18.853274 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-466e29f3-315c-496a-9c56-26b003d00c1d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:18.854003 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-466e29f3-315c-496a-9c56-26b003d00c1d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:18.970532 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-466e29f3-315c-496a-9c56-26b003d00c1d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 14 microversion: 2.20 time: 0.166949 Dec 14 10:13:18.971244 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 342/706] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:18 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:19.982007 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4eaa62aa-a899-487e-9754-70df8ef916c8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:19.983018 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4eaa62aa-a899-487e-9754-70df8ef916c8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:19.991551 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4eaa62aa-a899-487e-9754-70df8ef916c8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:19.992221 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4eaa62aa-a899-487e-9754-70df8ef916c8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:19.993227 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4eaa62aa-a899-487e-9754-70df8ef916c8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:19.994438 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4eaa62aa-a899-487e-9754-70df8ef916c8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:20.094371 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4eaa62aa-a899-487e-9754-70df8ef916c8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 14 microversion: 2.20 time: 0.116649 Dec 14 10:13:20.095893 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 365/707] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:19 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:21.106420 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-122322af-990a-4ce9-829e-ca9371eaeb68 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:21.107972 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-122322af-990a-4ce9-829e-ca9371eaeb68 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:21.116252 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-122322af-990a-4ce9-829e-ca9371eaeb68 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:21.116936 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-122322af-990a-4ce9-829e-ca9371eaeb68 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:21.117892 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-122322af-990a-4ce9-829e-ca9371eaeb68 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:21.119050 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-122322af-990a-4ce9-829e-ca9371eaeb68 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:21.248058 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-122322af-990a-4ce9-829e-ca9371eaeb68 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 14 microversion: 2.20 time: 0.145576 Dec 14 10:13:21.250971 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 343/708] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:21 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:22.261934 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-ceb7e0ba-22f7-4fb0-afa3-e677c4e8c000 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:22.263145 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-ceb7e0ba-22f7-4fb0-afa3-e677c4e8c000 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:22.270947 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ceb7e0ba-22f7-4fb0-afa3-e677c4e8c000 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:22.271470 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ceb7e0ba-22f7-4fb0-afa3-e677c4e8c000 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:22.272303 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ceb7e0ba-22f7-4fb0-afa3-e677c4e8c000 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:22.272840 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ceb7e0ba-22f7-4fb0-afa3-e677c4e8c000 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:22.385430 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-ceb7e0ba-22f7-4fb0-afa3-e677c4e8c000 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 7494 microversion: 2.20 time: 0.127822 Dec 14 10:13:22.386461 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 366/709] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:22 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 7494 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:13:23.398436 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-9151ebee-3596-4f50-9b9b-46762e4787e2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:23.400600 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-9151ebee-3596-4f50-9b9b-46762e4787e2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:23.419402 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9151ebee-3596-4f50-9b9b-46762e4787e2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:23.420185 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9151ebee-3596-4f50-9b9b-46762e4787e2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:23.421129 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9151ebee-3596-4f50-9b9b-46762e4787e2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:23.421722 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9151ebee-3596-4f50-9b9b-46762e4787e2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:23.595559 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-9151ebee-3596-4f50-9b9b-46762e4787e2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 15025 microversion: 2.20 time: 0.202295 Dec 14 10:13:23.596197 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 344/710] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:23 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 15025 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:24.608402 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c314c4cf-7b46-4456-8ad7-740e8fc57610 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:24.610508 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c314c4cf-7b46-4456-8ad7-740e8fc57610 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:24.627013 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c314c4cf-7b46-4456-8ad7-740e8fc57610 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:24.628516 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c314c4cf-7b46-4456-8ad7-740e8fc57610 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:24.630454 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c314c4cf-7b46-4456-8ad7-740e8fc57610 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:24.631068 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c314c4cf-7b46-4456-8ad7-740e8fc57610 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:24.817276 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c314c4cf-7b46-4456-8ad7-740e8fc57610 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 18356 microversion: 2.20 time: 0.213440 Dec 14 10:13:24.819008 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 367/711] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:24 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 18356 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:25.830585 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-2a74a29b-415f-4e6e-adca-7a2fd4eaf90e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:25.831585 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-2a74a29b-415f-4e6e-adca-7a2fd4eaf90e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:25.851033 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2a74a29b-415f-4e6e-adca-7a2fd4eaf90e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:25.851477 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2a74a29b-415f-4e6e-adca-7a2fd4eaf90e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:25.852261 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2a74a29b-415f-4e6e-adca-7a2fd4eaf90e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:25.852928 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2a74a29b-415f-4e6e-adca-7a2fd4eaf90e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:26.039893 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-2a74a29b-415f-4e6e-adca-7a2fd4eaf90e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 20148 microversion: 2.20 time: 0.213085 Dec 14 10:13:26.041031 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 345/712] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:25 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 20148 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:27.054789 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-328659c5-a7fd-46df-b7ff-146569b20aad tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:27.057530 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-328659c5-a7fd-46df-b7ff-146569b20aad tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:27.070547 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-328659c5-a7fd-46df-b7ff-146569b20aad tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:27.071777 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-328659c5-a7fd-46df-b7ff-146569b20aad tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:27.073122 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-328659c5-a7fd-46df-b7ff-146569b20aad tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:27.073751 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-328659c5-a7fd-46df-b7ff-146569b20aad tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:27.205357 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-328659c5-a7fd-46df-b7ff-146569b20aad tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 22716 microversion: 2.20 time: 0.156561 Dec 14 10:13:27.206426 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 368/713] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:27 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 22716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:28.218387 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-bd0aac2c-5fc2-46a3-b4b2-c41188c0e91e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:28.219559 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-bd0aac2c-5fc2-46a3-b4b2-c41188c0e91e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:28.236324 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bd0aac2c-5fc2-46a3-b4b2-c41188c0e91e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:28.236909 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bd0aac2c-5fc2-46a3-b4b2-c41188c0e91e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:28.239489 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bd0aac2c-5fc2-46a3-b4b2-c41188c0e91e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:28.240254 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bd0aac2c-5fc2-46a3-b4b2-c41188c0e91e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:28.369173 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-bd0aac2c-5fc2-46a3-b4b2-c41188c0e91e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 23804 microversion: 2.20 time: 0.153425 Dec 14 10:13:28.370595 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 346/714] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:28 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 23804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:29.387115 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-06e4d12b-c703-41cd-97c8-dbd4d201ed77 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:29.388837 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-06e4d12b-c703-41cd-97c8-dbd4d201ed77 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:29.402948 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-06e4d12b-c703-41cd-97c8-dbd4d201ed77 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:29.403397 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-06e4d12b-c703-41cd-97c8-dbd4d201ed77 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:29.404583 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-06e4d12b-c703-41cd-97c8-dbd4d201ed77 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:29.405015 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-06e4d12b-c703-41cd-97c8-dbd4d201ed77 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:29.544772 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-06e4d12b-c703-41cd-97c8-dbd4d201ed77 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 25034 microversion: 2.20 time: 0.165081 Dec 14 10:13:29.550568 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 369/715] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:29 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 25034 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:29.727388 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-0d3da417-243b-4adc-8287-098beb638810 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Action: 'create', calling method: .version_select at 0x7fb17a52ce50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-621328310"}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:29.750369 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-0d3da417-243b-4adc-8287-098beb638810 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Getting quotas for project 1381b4c2d5654dc2bf924671ef0ec4a3. Resources: {'key_pairs'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:13:29.754492 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-0d3da417-243b-4adc-8287-098beb638810 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Getting quotas for user e9766e50607147dbad279b733d671264 and project 1381b4c2d5654dc2bf924671ef0ec4a3. Resources: {'key_pairs'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:13:29.954367 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-0d3da417-243b-4adc-8287-098beb638810 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Getting quotas for project 1381b4c2d5654dc2bf924671ef0ec4a3. Resources: {'key_pairs'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:13:29.958720 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-0d3da417-243b-4adc-8287-098beb638810 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Getting quotas for user e9766e50607147dbad279b733d671264 and project 1381b4c2d5654dc2bf924671ef0ec4a3. Resources: {'key_pairs'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:13:29.974203 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-0d3da417-243b-4adc-8287-098beb638810 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.459890 Dec 14 10:13:29.975572 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 347/716] 10.222.0.20 () {60 vars in 1157 bytes} [Tue Dec 14 10:13:29 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:30.559482 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d2e74cd6-366b-4a07-8f01-dcf27943b483 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:30.574259 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d2e74cd6-366b-4a07-8f01-dcf27943b483 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:30.590530 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d2e74cd6-366b-4a07-8f01-dcf27943b483 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:30.592219 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d2e74cd6-366b-4a07-8f01-dcf27943b483 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:30.593938 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d2e74cd6-366b-4a07-8f01-dcf27943b483 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:30.599364 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d2e74cd6-366b-4a07-8f01-dcf27943b483 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:30.757179 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d2e74cd6-366b-4a07-8f01-dcf27943b483 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 26524 microversion: 2.20 time: 0.202588 Dec 14 10:13:30.758414 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 370/717] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:30 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 26524 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:31.769774 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3a06fac2-b364-4e79-86b3-c2553513c388 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:31.770821 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3a06fac2-b364-4e79-86b3-c2553513c388 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:31.779576 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3a06fac2-b364-4e79-86b3-c2553513c388 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:31.780396 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3a06fac2-b364-4e79-86b3-c2553513c388 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:31.781389 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3a06fac2-b364-4e79-86b3-c2553513c388 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:31.782065 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3a06fac2-b364-4e79-86b3-c2553513c388 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:31.896511 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3a06fac2-b364-4e79-86b3-c2553513c388 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 27440 microversion: 2.20 time: 0.130756 Dec 14 10:13:31.897176 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 348/718] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:31 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 27440 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:32.909949 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-957f1d75-39e0-4990-8bb6-f4ba4060a5d9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:32.911134 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-957f1d75-39e0-4990-8bb6-f4ba4060a5d9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:32.919541 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-957f1d75-39e0-4990-8bb6-f4ba4060a5d9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:32.920118 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-957f1d75-39e0-4990-8bb6-f4ba4060a5d9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:32.920996 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-957f1d75-39e0-4990-8bb6-f4ba4060a5d9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:32.921490 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-957f1d75-39e0-4990-8bb6-f4ba4060a5d9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:33.062849 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-957f1d75-39e0-4990-8bb6-f4ba4060a5d9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 27845 microversion: 2.20 time: 0.157084 Dec 14 10:13:33.064129 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 371/719] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:32 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 27845 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:34.077090 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-89faa3e8-5479-4a7a-b54d-e531642e67ce tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:34.078327 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-89faa3e8-5479-4a7a-b54d-e531642e67ce tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:34.086697 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-89faa3e8-5479-4a7a-b54d-e531642e67ce tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:34.087455 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-89faa3e8-5479-4a7a-b54d-e531642e67ce tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:34.089341 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-89faa3e8-5479-4a7a-b54d-e531642e67ce tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:34.089890 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-89faa3e8-5479-4a7a-b54d-e531642e67ce tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:34.233229 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-89faa3e8-5479-4a7a-b54d-e531642e67ce tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 28213 microversion: 2.20 time: 0.160125 Dec 14 10:13:34.234669 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 349/720] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:34 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 28213 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:35.257122 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-68e6e569-1155-40bd-9c18-dca8e1ae4d5e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:35.262378 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-68e6e569-1155-40bd-9c18-dca8e1ae4d5e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:35.283628 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-68e6e569-1155-40bd-9c18-dca8e1ae4d5e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:35.298572 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-68e6e569-1155-40bd-9c18-dca8e1ae4d5e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:35.302380 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-68e6e569-1155-40bd-9c18-dca8e1ae4d5e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:35.302935 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-68e6e569-1155-40bd-9c18-dca8e1ae4d5e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:35.449312 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-68e6e569-1155-40bd-9c18-dca8e1ae4d5e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 28213 microversion: 2.20 time: 0.205715 Dec 14 10:13:35.452702 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 372/721] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:35 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 28213 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:36.465153 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e212679d-ff7e-40f4-82a5-5d603e1e26f0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:36.466235 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e212679d-ff7e-40f4-82a5-5d603e1e26f0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:36.474143 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e212679d-ff7e-40f4-82a5-5d603e1e26f0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:36.474596 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e212679d-ff7e-40f4-82a5-5d603e1e26f0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:36.475357 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e212679d-ff7e-40f4-82a5-5d603e1e26f0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:36.475788 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e212679d-ff7e-40f4-82a5-5d603e1e26f0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:36.583974 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e212679d-ff7e-40f4-82a5-5d603e1e26f0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 28213 microversion: 2.20 time: 0.123640 Dec 14 10:13:36.584609 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 350/722] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:36 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 28213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:37.597139 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-7d296238-bc58-4562-927c-c6f8cd202ee6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:37.598254 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-7d296238-bc58-4562-927c-c6f8cd202ee6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:37.606837 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7d296238-bc58-4562-927c-c6f8cd202ee6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:37.607285 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7d296238-bc58-4562-927c-c6f8cd202ee6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:37.608179 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7d296238-bc58-4562-927c-c6f8cd202ee6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:37.608611 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7d296238-bc58-4562-927c-c6f8cd202ee6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:37.728846 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-7d296238-bc58-4562-927c-c6f8cd202ee6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 28504 microversion: 2.20 time: 0.135727 Dec 14 10:13:37.729489 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 373/723] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:37 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 28504 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:38.741131 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-feaccf22-ca08-4fda-8fd4-d850bd6eb2b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:38.742113 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-feaccf22-ca08-4fda-8fd4-d850bd6eb2b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:38.750531 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-feaccf22-ca08-4fda-8fd4-d850bd6eb2b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:38.751234 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-feaccf22-ca08-4fda-8fd4-d850bd6eb2b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:38.752184 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-feaccf22-ca08-4fda-8fd4-d850bd6eb2b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:38.752625 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-feaccf22-ca08-4fda-8fd4-d850bd6eb2b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:38.869980 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-feaccf22-ca08-4fda-8fd4-d850bd6eb2b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 28672 microversion: 2.20 time: 0.133052 Dec 14 10:13:38.874355 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 351/724] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:38 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 28672 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:39.882530 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-34fdab49-1a29-4b1d-9322-3d2f471f6739 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:39.883583 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-34fdab49-1a29-4b1d-9322-3d2f471f6739 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:39.891580 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-34fdab49-1a29-4b1d-9322-3d2f471f6739 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:39.892048 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-34fdab49-1a29-4b1d-9322-3d2f471f6739 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:39.892801 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-34fdab49-1a29-4b1d-9322-3d2f471f6739 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:39.893228 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-34fdab49-1a29-4b1d-9322-3d2f471f6739 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:39.991435 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-34fdab49-1a29-4b1d-9322-3d2f471f6739 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 28672 microversion: 2.20 time: 0.112901 Dec 14 10:13:39.992320 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 374/725] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:39 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 28672 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:41.003673 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a8f2f5df-c684-454b-8ecd-7d9f0fb707ae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:41.004572 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a8f2f5df-c684-454b-8ecd-7d9f0fb707ae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:41.012392 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a8f2f5df-c684-454b-8ecd-7d9f0fb707ae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:41.012847 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a8f2f5df-c684-454b-8ecd-7d9f0fb707ae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:41.013615 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a8f2f5df-c684-454b-8ecd-7d9f0fb707ae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:41.014080 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a8f2f5df-c684-454b-8ecd-7d9f0fb707ae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:41.110961 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a8f2f5df-c684-454b-8ecd-7d9f0fb707ae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 28672 microversion: 2.20 time: 0.111251 Dec 14 10:13:41.111591 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 352/726] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:40 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 28672 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 10:13:42.123928 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-880be39b-3db5-4705-b5c2-c4e20309a1fd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:42.125037 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-880be39b-3db5-4705-b5c2-c4e20309a1fd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:42.132942 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-880be39b-3db5-4705-b5c2-c4e20309a1fd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:42.133363 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-880be39b-3db5-4705-b5c2-c4e20309a1fd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:42.134216 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-880be39b-3db5-4705-b5c2-c4e20309a1fd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:42.134640 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-880be39b-3db5-4705-b5c2-c4e20309a1fd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:42.241242 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-880be39b-3db5-4705-b5c2-c4e20309a1fd tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 28672 microversion: 2.20 time: 0.121572 Dec 14 10:13:42.241881 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 375/727] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:42 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 28672 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:43.253272 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a9b975c2-db78-4833-99ff-2d487144db7f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:43.254297 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a9b975c2-db78-4833-99ff-2d487144db7f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:43.262366 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a9b975c2-db78-4833-99ff-2d487144db7f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:43.262819 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a9b975c2-db78-4833-99ff-2d487144db7f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:43.263824 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a9b975c2-db78-4833-99ff-2d487144db7f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:43.264264 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a9b975c2-db78-4833-99ff-2d487144db7f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:43.366918 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a9b975c2-db78-4833-99ff-2d487144db7f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 28672 microversion: 2.20 time: 0.117672 Dec 14 10:13:43.371506 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 353/728] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:43 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 28672 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:44.379898 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-91b24a07-a0cb-4695-9fe7-92609fb1eaeb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:44.380910 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-91b24a07-a0cb-4695-9fe7-92609fb1eaeb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:44.388721 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-91b24a07-a0cb-4695-9fe7-92609fb1eaeb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:44.389163 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-91b24a07-a0cb-4695-9fe7-92609fb1eaeb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:44.389923 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-91b24a07-a0cb-4695-9fe7-92609fb1eaeb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:44.390374 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-91b24a07-a0cb-4695-9fe7-92609fb1eaeb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:44.518849 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-91b24a07-a0cb-4695-9fe7-92609fb1eaeb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 29198 microversion: 2.20 time: 0.142775 Dec 14 10:13:44.519547 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 376/729] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:44 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 29198 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:45.532225 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-05199d4a-e47c-4fd3-8437-70130c606a7b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:45.533221 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-05199d4a-e47c-4fd3-8437-70130c606a7b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:45.540922 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-05199d4a-e47c-4fd3-8437-70130c606a7b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:45.541480 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-05199d4a-e47c-4fd3-8437-70130c606a7b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:45.542401 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-05199d4a-e47c-4fd3-8437-70130c606a7b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:45.542838 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-05199d4a-e47c-4fd3-8437-70130c606a7b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:45.660289 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-05199d4a-e47c-4fd3-8437-70130c606a7b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 30647 microversion: 2.20 time: 0.132000 Dec 14 10:13:45.660920 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 354/730] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:45 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 30647 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 10:13:46.619025 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-79aef3ab-8ea3-4577-8bb9-f62a2839e217 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-72617066"}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:46.619849 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-79aef3ab-8ea3-4577-8bb9-f62a2839e217 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:46.628307 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-79aef3ab-8ea3-4577-8bb9-f62a2839e217 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:46.628760 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-79aef3ab-8ea3-4577-8bb9-f62a2839e217 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:46.629581 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-79aef3ab-8ea3-4577-8bb9-f62a2839e217 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:46.630046 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-79aef3ab-8ea3-4577-8bb9-f62a2839e217 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:46.672948 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-4c04eef3-b024-4986-b80c-2a5d45e4f906 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:46.674040 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-4c04eef3-b024-4986-b80c-2a5d45e4f906 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:46.682117 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4c04eef3-b024-4986-b80c-2a5d45e4f906 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:46.682572 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4c04eef3-b024-4986-b80c-2a5d45e4f906 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:46.683338 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4c04eef3-b024-4986-b80c-2a5d45e4f906 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:46.683799 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4c04eef3-b024-4986-b80c-2a5d45e4f906 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:46.815698 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-4c04eef3-b024-4986-b80c-2a5d45e4f906 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 32271 microversion: 2.20 time: 0.146596 Dec 14 10:13:46.819603 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 355/731] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:46 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 32271 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 10:13:46.820909 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.network.security_group_api [None req-79aef3ab-8ea3-4577-8bb9-f62a2839e217 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Removing security group e7edf751-f9d6-4f9e-a223-6d90a7db3f33 from port 35d84917-4bee-46b2-a5e4-3ff2c82add1c Dec 14 10:13:47.303460 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-79aef3ab-8ea3-4577-8bb9-f62a2839e217 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "POST /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa/action" status: 202 len: 0 microversion: 2.1 time: 0.688373 Dec 14 10:13:47.304586 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 377/732] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:13:46 2021] POST /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa/action => generated 0 bytes in 691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 14 10:13:47.528769 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-796b4573-e4cb-4366-ad57-f82e09d7a895 req-075f30af-1e08-4544-88bd-bf8f8a533565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b8c891-6fe6-4b09-8254-77c354e67aaa", "tag": "35d84917-4bee-46b2-a5e4-3ff2c82add1c"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:47.530384 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:13:47.530384 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:13:47.555095 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-796b4573-e4cb-4366-ad57-f82e09d7a895 req-075f30af-1e08-4544-88bd-bf8f8a533565 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:47.558852 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-796b4573-e4cb-4366-ad57-f82e09d7a895 req-075f30af-1e08-4544-88bd-bf8f8a533565 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:47.583327 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-796b4573-e4cb-4366-ad57-f82e09d7a895 req-075f30af-1e08-4544-88bd-bf8f8a533565 service nova] Creating event network-changed:35d84917-4bee-46b2-a5e4-3ff2c82add1c for instance 12b8c891-6fe6-4b09-8254-77c354e67aaa on hv-cinder-81888 Dec 14 10:13:47.588184 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-796b4573-e4cb-4366-ad57-f82e09d7a895 req-075f30af-1e08-4544-88bd-bf8f8a533565 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.273860 Dec 14 10:13:47.589338 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 356/733] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:13:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:13:47.828215 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-48335240-7306-445f-b6a1-11895b0ec23a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:47.829944 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-48335240-7306-445f-b6a1-11895b0ec23a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:47.840199 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-48335240-7306-445f-b6a1-11895b0ec23a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:47.840898 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-48335240-7306-445f-b6a1-11895b0ec23a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:47.841683 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-48335240-7306-445f-b6a1-11895b0ec23a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:47.842167 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-48335240-7306-445f-b6a1-11895b0ec23a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:47.962669 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-48335240-7306-445f-b6a1-11895b0ec23a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 33123 microversion: 2.20 time: 0.138443 Dec 14 10:13:47.964081 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 378/734] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:47 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 33123 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:48.976461 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-123f26b8-6cc8-4311-babf-a02b7949a41c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:48.977870 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-123f26b8-6cc8-4311-babf-a02b7949a41c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:48.986208 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-123f26b8-6cc8-4311-babf-a02b7949a41c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:48.986866 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-123f26b8-6cc8-4311-babf-a02b7949a41c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:48.988531 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-123f26b8-6cc8-4311-babf-a02b7949a41c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:48.989138 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-123f26b8-6cc8-4311-babf-a02b7949a41c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:49.115534 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-123f26b8-6cc8-4311-babf-a02b7949a41c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 33878 microversion: 2.20 time: 0.143526 Dec 14 10:13:49.116448 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 357/735] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:48 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 33878 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:49.802299 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-88e81721-055c-448c-9e98-948bdc39cf59 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:49.803413 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-88e81721-055c-448c-9e98-948bdc39cf59 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:49.824770 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-88e81721-055c-448c-9e98-948bdc39cf59 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:49.825209 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-88e81721-055c-448c-9e98-948bdc39cf59 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:49.826578 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-88e81721-055c-448c-9e98-948bdc39cf59 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:49.827165 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-88e81721-055c-448c-9e98-948bdc39cf59 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:49.876972 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-c7a29924-aef7-484a-a4e0-24f708654fdb req-52b71fc1-30f8-48b5-8a16-3b094d95bb5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b8c891-6fe6-4b09-8254-77c354e67aaa", "tag": "35d84917-4bee-46b2-a5e4-3ff2c82add1c"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:49.879094 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:13:49.879094 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:13:49.888302 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-c7a29924-aef7-484a-a4e0-24f708654fdb req-52b71fc1-30f8-48b5-8a16-3b094d95bb5d service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:49.888904 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-c7a29924-aef7-484a-a4e0-24f708654fdb req-52b71fc1-30f8-48b5-8a16-3b094d95bb5d service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:49.905724 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-c7a29924-aef7-484a-a4e0-24f708654fdb req-52b71fc1-30f8-48b5-8a16-3b094d95bb5d service nova] Creating event network-changed:35d84917-4bee-46b2-a5e4-3ff2c82add1c for instance 12b8c891-6fe6-4b09-8254-77c354e67aaa on hv-cinder-81888 Dec 14 10:13:49.911685 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-c7a29924-aef7-484a-a4e0-24f708654fdb req-52b71fc1-30f8-48b5-8a16-3b094d95bb5d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108637 Dec 14 10:13:49.912846 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 358/736] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:13:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:13:50.003083 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.objects.instance [None req-88e81721-055c-448c-9e98-948bdc39cf59 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lazy-loading 'services' on Instance uuid 12b8c891-6fe6-4b09-8254-77c354e67aaa {{(pid=100984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:13:50.127969 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f299de14-57f0-440a-b39b-7e827c695753 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:50.128977 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f299de14-57f0-440a-b39b-7e827c695753 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:50.141812 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f299de14-57f0-440a-b39b-7e827c695753 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:50.142291 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f299de14-57f0-440a-b39b-7e827c695753 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:50.144334 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f299de14-57f0-440a-b39b-7e827c695753 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:50.144782 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f299de14-57f0-440a-b39b-7e827c695753 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:50.206950 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-88e81721-055c-448c-9e98-948bdc39cf59 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "DELETE /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa/os-volume_attachments/8256ab6f-1e4b-4975-905f-182c11b3d9c6" status: 202 len: 0 microversion: 2.1 time: 0.408772 Dec 14 10:13:50.207578 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 379/737] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Dec 14 10:13:49 2021] DELETE /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa/os-volume_attachments/8256ab6f-1e4b-4975-905f-182c11b3d9c6 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:50.216824 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-77e952e1-c253-44b9-b958-84e2a5e3b2a2 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:50.220611 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-77e952e1-c253-44b9-b958-84e2a5e3b2a2 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:50.236389 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-77e952e1-c253-44b9-b958-84e2a5e3b2a2 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:50.236841 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-77e952e1-c253-44b9-b958-84e2a5e3b2a2 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:50.238152 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-77e952e1-c253-44b9-b958-84e2a5e3b2a2 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:50.238805 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-77e952e1-c253-44b9-b958-84e2a5e3b2a2 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:50.320520 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-77e952e1-c253-44b9-b958-84e2a5e3b2a2 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108544 Dec 14 10:13:50.320849 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f299de14-57f0-440a-b39b-7e827c695753 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 35242 microversion: 2.20 time: 0.197098 Dec 14 10:13:50.329188 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 359/738] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:50 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 35242 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:50.329498 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 380/739] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:13:50 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:13:50.683270 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a4ce80fb-67ae-48bf-ab65-b564093bd2d2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2051271211", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-621328310", "security_groups": [{"name": "tempest-secgroup-smoke-442028405"}], "block_device_mapping_v2": [{"uuid": "1a1784b6-5677-4265-a537-de8f08aa7a18", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bd1cbab0-8707-4ef3-99d9-9624dbe62aa4"}]}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:50.873731 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.network.neutron [None req-a4ce80fb-67ae-48bf-ab65-b564093bd2d2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] validate_networks() for [('bd1cbab0-8707-4ef3-99d9-9624dbe62aa4', None, None, None)] {{(pid=100985) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:13:51.007980 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-aa8ab68e-9af5-440f-b335-adda3ec317d0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:51.009037 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-aa8ab68e-9af5-440f-b335-adda3ec317d0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:51.016741 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aa8ab68e-9af5-440f-b335-adda3ec317d0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:51.017457 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aa8ab68e-9af5-440f-b335-adda3ec317d0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:51.018556 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aa8ab68e-9af5-440f-b335-adda3ec317d0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:51.019189 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aa8ab68e-9af5-440f-b335-adda3ec317d0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:51.089386 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-aa8ab68e-9af5-440f-b335-adda3ec317d0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088731 Dec 14 10:13:51.089986 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 381/740] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:13:50 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 14 10:13:51.189083 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-007c02b5-fa97-457b-8802-0d11de1e8555 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:51.189579 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-007c02b5-fa97-457b-8802-0d11de1e8555 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:51.197357 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-007c02b5-fa97-457b-8802-0d11de1e8555 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:51.197793 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-007c02b5-fa97-457b-8802-0d11de1e8555 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:51.198622 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-007c02b5-fa97-457b-8802-0d11de1e8555 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:51.199054 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-007c02b5-fa97-457b-8802-0d11de1e8555 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:51.268964 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-007c02b5-fa97-457b-8802-0d11de1e8555 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Going to try to terminate instance {{(pid=100984) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:13:51.418639 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-007c02b5-fa97-457b-8802-0d11de1e8555 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 204 len: 0 microversion: 2.1 time: 0.232826 Dec 14 10:13:51.419960 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 382/741] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:13:51 2021] DELETE /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 14 10:13:51.426872 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4bce32c9-e928-4778-93a9-4de7f4d6dd3e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:51.428188 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4bce32c9-e928-4778-93a9-4de7f4d6dd3e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:51.436761 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4bce32c9-e928-4778-93a9-4de7f4d6dd3e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:51.437474 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4bce32c9-e928-4778-93a9-4de7f4d6dd3e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:51.438503 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4bce32c9-e928-4778-93a9-4de7f4d6dd3e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:51.439130 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4bce32c9-e928-4778-93a9-4de7f4d6dd3e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:51.550433 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4bce32c9-e928-4778-93a9-4de7f4d6dd3e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 36656 microversion: 2.20 time: 0.128642 Dec 14 10:13:51.554894 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 383/742] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:51 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 36656 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:51.556618 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-2d2742f6-8ce4-4120-9d12-3794418284b8 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:51.557625 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-2d2742f6-8ce4-4120-9d12-3794418284b8 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:51.565524 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2d2742f6-8ce4-4120-9d12-3794418284b8 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:51.565927 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2d2742f6-8ce4-4120-9d12-3794418284b8 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:51.566729 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2d2742f6-8ce4-4120-9d12-3794418284b8 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:51.567259 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2d2742f6-8ce4-4120-9d12-3794418284b8 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:51.637256 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-2d2742f6-8ce4-4120-9d12-3794418284b8 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084533 Dec 14 10:13:51.637593 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 384/743] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:13:51 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 10:13:51.641856 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1cb84b24-a582-48c7-a5f8-ac97d1fa9eda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:51.642496 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1cb84b24-a582-48c7-a5f8-ac97d1fa9eda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:51.650961 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1cb84b24-a582-48c7-a5f8-ac97d1fa9eda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:51.651622 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1cb84b24-a582-48c7-a5f8-ac97d1fa9eda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:51.652404 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1cb84b24-a582-48c7-a5f8-ac97d1fa9eda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:51.652838 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1cb84b24-a582-48c7-a5f8-ac97d1fa9eda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:51.670507 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-a4ce80fb-67ae-48bf-ab65-b564093bd2d2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Flavor limits 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:13:51.671149 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-a4ce80fb-67ae-48bf-ab65-b564093bd2d2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Image limits 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:13:51.671870 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-a4ce80fb-67ae-48bf-ab65-b564093bd2d2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Flavor pref 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:13:51.672397 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-a4ce80fb-67ae-48bf-ab65-b564093bd2d2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Image pref 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:13:51.672910 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-a4ce80fb-67ae-48bf-ab65-b564093bd2d2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:13:51.681598 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a4ce80fb-67ae-48bf-ab65-b564093bd2d2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:51.682202 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a4ce80fb-67ae-48bf-ab65-b564093bd2d2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:51.683105 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a4ce80fb-67ae-48bf-ab65-b564093bd2d2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:51.683639 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a4ce80fb-67ae-48bf-ab65-b564093bd2d2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:51.702857 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-a4ce80fb-67ae-48bf-ab65-b564093bd2d2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Getting quotas for project 1381b4c2d5654dc2bf924671ef0ec4a3. Resources: {'cores', 'instances', 'ram'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:13:51.707472 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-a4ce80fb-67ae-48bf-ab65-b564093bd2d2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Getting quotas for user e9766e50607147dbad279b733d671264 and project 1381b4c2d5654dc2bf924671ef0ec4a3. Resources: {'cores', 'instances', 'ram'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:13:51.796690 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a4ce80fb-67ae-48bf-ab65-b564093bd2d2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Going to run 1 instances... {{(pid=100985) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:13:51.799059 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a4ce80fb-67ae-48bf-ab65-b564093bd2d2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1a1784b6-5677-4265-a537-de8f08aa7a18',volume_size=None,volume_type=None)] {{(pid=100985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:13:51.967604 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a4ce80fb-67ae-48bf-ab65-b564093bd2d2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.288418 Dec 14 10:13:51.973091 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 360/744] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Dec 14 10:13:50 2021] POST /compute/v2.1/servers => generated 405 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 10:13:51.973091 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-aab77a6d-caff-4ab5-a74f-74dedcee3280 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:51.973703 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-aab77a6d-caff-4ab5-a74f-74dedcee3280 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:51.982860 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-aab77a6d-caff-4ab5-a74f-74dedcee3280 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:51.983386 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-aab77a6d-caff-4ab5-a74f-74dedcee3280 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:51.985339 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-aab77a6d-caff-4ab5-a74f-74dedcee3280 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:51.986052 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-aab77a6d-caff-4ab5-a74f-74dedcee3280 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:52.042405 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1cb84b24-a582-48c7-a5f8-ac97d1fa9eda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:52.058114 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1cb84b24-a582-48c7-a5f8-ac97d1fa9eda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1675 microversion: 2.1 time: 0.417839 Dec 14 10:13:52.058114 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 385/745] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:51 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1675 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:52.083336 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-ea91a889-ffd0-4c2f-9c95-58de3645ff01 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:52.083952 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-ea91a889-ffd0-4c2f-9c95-58de3645ff01 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:52.167759 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-ea91a889-ffd0-4c2f-9c95-58de3645ff01 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:52.171390 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-aab77a6d-caff-4ab5-a74f-74dedcee3280 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] HTTP exception thrown: Instance 12b8c891-6fe6-4b09-8254-77c354e67aaa is not attached to volume 8256ab6f-1e4b-4975-905f-182c11b3d9c6 Dec 14 10:13:52.172069 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-aab77a6d-caff-4ab5-a74f-74dedcee3280 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Returning 404 to user: Instance 12b8c891-6fe6-4b09-8254-77c354e67aaa is not attached to volume 8256ab6f-1e4b-4975-905f-182c11b3d9c6 {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:13:52.173134 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-aab77a6d-caff-4ab5-a74f-74dedcee3280 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "DELETE /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa/os-volume_attachments/8256ab6f-1e4b-4975-905f-182c11b3d9c6" status: 404 len: 154 microversion: 2.1 time: 0.203881 Dec 14 10:13:52.173758 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 361/746] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Dec 14 10:13:51 2021] DELETE /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa/os-volume_attachments/8256ab6f-1e4b-4975-905f-182c11b3d9c6 => generated 154 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:13:52.178121 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-ea91a889-ffd0-4c2f-9c95-58de3645ff01 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1094 microversion: 2.1 time: 0.106159 Dec 14 10:13:52.179931 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 386/747] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:52 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1094 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:52.563205 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-0afa5203-db3f-40c7-912a-f994f1e15fa4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:52.564275 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-0afa5203-db3f-40c7-912a-f994f1e15fa4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:52.572267 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0afa5203-db3f-40c7-912a-f994f1e15fa4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:52.572820 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0afa5203-db3f-40c7-912a-f994f1e15fa4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:52.573885 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0afa5203-db3f-40c7-912a-f994f1e15fa4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:52.574563 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0afa5203-db3f-40c7-912a-f994f1e15fa4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:52.699481 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-0afa5203-db3f-40c7-912a-f994f1e15fa4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 37856 microversion: 2.20 time: 0.140163 Dec 14 10:13:52.700715 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 362/748] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:52 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 37856 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 10:13:53.075761 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-74638e8d-63c8-4dce-af69-feb11514abe5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:53.076368 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-74638e8d-63c8-4dce-af69-feb11514abe5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:53.084297 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-74638e8d-63c8-4dce-af69-feb11514abe5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:53.084737 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-74638e8d-63c8-4dce-af69-feb11514abe5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:53.085526 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-74638e8d-63c8-4dce-af69-feb11514abe5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:53.085965 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-74638e8d-63c8-4dce-af69-feb11514abe5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:53.196457 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-20ce34f7-6c1e-441d-a44c-c4b9106db409 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:53.197691 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-20ce34f7-6c1e-441d-a44c-c4b9106db409 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:53.205415 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-20ce34f7-6c1e-441d-a44c-c4b9106db409 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:53.205855 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-20ce34f7-6c1e-441d-a44c-c4b9106db409 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:53.206666 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-20ce34f7-6c1e-441d-a44c-c4b9106db409 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:53.207097 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-20ce34f7-6c1e-441d-a44c-c4b9106db409 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:53.440776 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-20ce34f7-6c1e-441d-a44c-c4b9106db409 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:53.453854 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-20ce34f7-6c1e-441d-a44c-c4b9106db409 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1200 microversion: 2.1 time: 0.261213 Dec 14 10:13:53.455278 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 363/749] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:53 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1200 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:13:53.464779 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-71b41bce-76ca-4b14-95dc-0a9208912dc3 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:53.465681 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-71b41bce-76ca-4b14-95dc-0a9208912dc3 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:53.474374 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-71b41bce-76ca-4b14-95dc-0a9208912dc3 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:53.475152 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-71b41bce-76ca-4b14-95dc-0a9208912dc3 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:53.477738 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-71b41bce-76ca-4b14-95dc-0a9208912dc3 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:53.478443 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-71b41bce-76ca-4b14-95dc-0a9208912dc3 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:53.552744 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-71b41bce-76ca-4b14-95dc-0a9208912dc3 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Going to try to terminate instance {{(pid=100985) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:13:53.581993 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-74638e8d-63c8-4dce-af69-feb11514abe5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:53.593344 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-74638e8d-63c8-4dce-af69-feb11514abe5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1675 microversion: 2.1 time: 0.521751 Dec 14 10:13:53.609902 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 387/750] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:53 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1675 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:53.712305 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-fd9efe29-bfc1-4139-a47c-137156e6c057 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:53.714400 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-fd9efe29-bfc1-4139-a47c-137156e6c057 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:53.723599 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-71b41bce-76ca-4b14-95dc-0a9208912dc3 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "DELETE /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 204 len: 0 microversion: 2.1 time: 0.265721 Dec 14 10:13:53.726037 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 364/751] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:13:53 2021] DELETE /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 10:13:53.732435 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fd9efe29-bfc1-4139-a47c-137156e6c057 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:53.732873 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fd9efe29-bfc1-4139-a47c-137156e6c057 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:53.733641 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fd9efe29-bfc1-4139-a47c-137156e6c057 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:53.734104 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fd9efe29-bfc1-4139-a47c-137156e6c057 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:53.736049 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3ff1563e-d48e-49f8-a42b-9e6d820599c6 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:53.736906 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3ff1563e-d48e-49f8-a42b-9e6d820599c6 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:53.745002 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3ff1563e-d48e-49f8-a42b-9e6d820599c6 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:53.745454 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3ff1563e-d48e-49f8-a42b-9e6d820599c6 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:53.748807 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3ff1563e-d48e-49f8-a42b-9e6d820599c6 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:53.754184 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3ff1563e-d48e-49f8-a42b-9e6d820599c6 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:53.862223 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-fd9efe29-bfc1-4139-a47c-137156e6c057 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 38227 microversion: 2.20 time: 0.153139 Dec 14 10:13:53.866037 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 388/752] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:53 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 38227 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:54.472024 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1c778b8a-32c9-4400-9c01-d97662da7045 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:54.472842 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1c778b8a-32c9-4400-9c01-d97662da7045 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:54.482688 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1c778b8a-32c9-4400-9c01-d97662da7045 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:54.483194 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1c778b8a-32c9-4400-9c01-d97662da7045 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:54.484065 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1c778b8a-32c9-4400-9c01-d97662da7045 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:54.484765 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1c778b8a-32c9-4400-9c01-d97662da7045 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:54.618834 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1c778b8a-32c9-4400-9c01-d97662da7045 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:54.628217 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1c778b8a-32c9-4400-9c01-d97662da7045 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1198 microversion: 2.1 time: 0.160212 Dec 14 10:13:54.637346 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 389/753] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:54 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1198 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:13:54.637346 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-dfe1473d-cf09-4e77-98a4-fe5acdf089a6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:54.637346 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-dfe1473d-cf09-4e77-98a4-fe5acdf089a6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:54.641165 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3ff1563e-d48e-49f8-a42b-9e6d820599c6 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:54.645484 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dfe1473d-cf09-4e77-98a4-fe5acdf089a6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:54.645849 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dfe1473d-cf09-4e77-98a4-fe5acdf089a6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:54.646759 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dfe1473d-cf09-4e77-98a4-fe5acdf089a6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:54.647326 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dfe1473d-cf09-4e77-98a4-fe5acdf089a6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:54.653146 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3ff1563e-d48e-49f8-a42b-9e6d820599c6 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1553 microversion: 2.1 time: 0.922928 Dec 14 10:13:54.653939 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 365/754] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:53 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1553 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:13:54.875947 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-dfe1473d-cf09-4e77-98a4-fe5acdf089a6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:54.876370 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-72c2eeda-d44f-4328-b8cc-c87bef008c91 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:54.877392 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-72c2eeda-d44f-4328-b8cc-c87bef008c91 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:54.885487 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-72c2eeda-d44f-4328-b8cc-c87bef008c91 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:54.886189 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-72c2eeda-d44f-4328-b8cc-c87bef008c91 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:54.886737 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-dfe1473d-cf09-4e77-98a4-fe5acdf089a6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1675 microversion: 2.1 time: 0.256419 Dec 14 10:13:54.887190 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-72c2eeda-d44f-4328-b8cc-c87bef008c91 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:54.887628 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-72c2eeda-d44f-4328-b8cc-c87bef008c91 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:54.897569 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 390/755] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:54 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1675 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:54.989507 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-72c2eeda-d44f-4328-b8cc-c87bef008c91 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 38227 microversion: 2.20 time: 0.117198 Dec 14 10:13:54.995391 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 366/756] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:54 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 38227 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 10:13:55.646598 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-eb188b1c-8bb9-4270-af50-7d7bfb5e34cf tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:55.647368 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-eb188b1c-8bb9-4270-af50-7d7bfb5e34cf tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:55.656217 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-eb188b1c-8bb9-4270-af50-7d7bfb5e34cf tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:55.656675 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-eb188b1c-8bb9-4270-af50-7d7bfb5e34cf tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:55.657740 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-eb188b1c-8bb9-4270-af50-7d7bfb5e34cf tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:55.658228 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-eb188b1c-8bb9-4270-af50-7d7bfb5e34cf tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:55.670285 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-0e5f05fb-30e7-4446-becb-a6d5b4d1053b tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:55.670979 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-0e5f05fb-30e7-4446-becb-a6d5b4d1053b tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:55.691290 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0e5f05fb-30e7-4446-becb-a6d5b4d1053b tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:55.691725 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0e5f05fb-30e7-4446-becb-a6d5b4d1053b tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:55.692504 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0e5f05fb-30e7-4446-becb-a6d5b4d1053b tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:55.692928 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0e5f05fb-30e7-4446-becb-a6d5b4d1053b tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:55.910698 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-eb188b1c-8bb9-4270-af50-7d7bfb5e34cf tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:55.923382 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-eb188b1c-8bb9-4270-af50-7d7bfb5e34cf tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1265 microversion: 2.1 time: 0.280692 Dec 14 10:13:55.924422 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 391/757] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:55 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:55.939799 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-04f8ffce-29db-479d-8492-59d6c3a203ca tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:55.940602 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-04f8ffce-29db-479d-8492-59d6c3a203ca tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:55.951746 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-04f8ffce-29db-479d-8492-59d6c3a203ca tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:55.952181 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-04f8ffce-29db-479d-8492-59d6c3a203ca tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:55.952949 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-04f8ffce-29db-479d-8492-59d6c3a203ca tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:55.953372 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-04f8ffce-29db-479d-8492-59d6c3a203ca tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:56.131722 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-04f8ffce-29db-479d-8492-59d6c3a203ca tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:56.141594 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-04f8ffce-29db-479d-8492-59d6c3a203ca tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1607 microversion: 2.1 time: 0.215611 Dec 14 10:13:56.142500 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 392/758] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:55 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1607 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:56.148694 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f0e13acc-95ae-409f-b7d4-96277e42c40d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:56.150223 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f0e13acc-95ae-409f-b7d4-96277e42c40d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:56.159114 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f0e13acc-95ae-409f-b7d4-96277e42c40d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:56.159854 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f0e13acc-95ae-409f-b7d4-96277e42c40d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:56.160824 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f0e13acc-95ae-409f-b7d4-96277e42c40d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:56.161413 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f0e13acc-95ae-409f-b7d4-96277e42c40d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:56.276406 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f0e13acc-95ae-409f-b7d4-96277e42c40d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 38301 microversion: 2.20 time: 0.131723 Dec 14 10:13:56.277878 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 393/759] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:56 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 38301 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:56.748687 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-0e5f05fb-30e7-4446-becb-a6d5b4d1053b tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:56.761550 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-0e5f05fb-30e7-4446-becb-a6d5b4d1053b tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1553 microversion: 2.1 time: 1.094878 Dec 14 10:13:56.762273 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 367/760] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:55 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1553 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:56.778709 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-40302791-84f6-477e-a8c1-acbda8ae4d23 req-14af055c-c4a7-4ca9-977e-4c11d2dd124c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cb52f05-26bc-4f5b-be4f-f7ad45e4570f", "name": "network-vif-deleted", "tag": "9b3dfaef-7974-48de-8abf-01274b059c49"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:56.782552 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:13:56.782552 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:13:56.812099 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-40302791-84f6-477e-a8c1-acbda8ae4d23 req-14af055c-c4a7-4ca9-977e-4c11d2dd124c service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:56.812740 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-40302791-84f6-477e-a8c1-acbda8ae4d23 req-14af055c-c4a7-4ca9-977e-4c11d2dd124c service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:56.840973 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-40302791-84f6-477e-a8c1-acbda8ae4d23 req-14af055c-c4a7-4ca9-977e-4c11d2dd124c service nova] Creating event network-vif-deleted:9b3dfaef-7974-48de-8abf-01274b059c49 for instance 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f on hv-cinder-81888 Dec 14 10:13:56.854490 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-40302791-84f6-477e-a8c1-acbda8ae4d23 req-14af055c-c4a7-4ca9-977e-4c11d2dd124c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080065 Dec 14 10:13:56.859267 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 394/761] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:13:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:13:56.949628 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-dbad902a-a7e1-479b-a66c-8000b0ad8588 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:56.951109 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-dbad902a-a7e1-479b-a66c-8000b0ad8588 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:56.959944 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dbad902a-a7e1-479b-a66c-8000b0ad8588 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:56.960925 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dbad902a-a7e1-479b-a66c-8000b0ad8588 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:56.962029 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dbad902a-a7e1-479b-a66c-8000b0ad8588 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:56.963196 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dbad902a-a7e1-479b-a66c-8000b0ad8588 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:57.161913 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-6d48cb12-2317-4f63-a6a4-b8e13f4f4344 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:57.163106 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-6d48cb12-2317-4f63-a6a4-b8e13f4f4344 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:57.172325 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6d48cb12-2317-4f63-a6a4-b8e13f4f4344 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:57.173667 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6d48cb12-2317-4f63-a6a4-b8e13f4f4344 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:57.174706 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6d48cb12-2317-4f63-a6a4-b8e13f4f4344 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:57.175882 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6d48cb12-2317-4f63-a6a4-b8e13f4f4344 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:57.287322 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6d48cb12-2317-4f63-a6a4-b8e13f4f4344 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:57.287907 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6d48cb12-2317-4f63-a6a4-b8e13f4f4344 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:57.288584 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.objects.instance [None req-6d48cb12-2317-4f63-a6a4-b8e13f4f4344 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lazy-loading 'fault' on Instance uuid 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f {{(pid=100984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:13:57.356126 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-6d48cb12-2317-4f63-a6a4-b8e13f4f4344 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:57.365949 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-6d48cb12-2317-4f63-a6a4-b8e13f4f4344 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 200 len: 1328 microversion: 2.1 time: 0.209868 Dec 14 10:13:57.366781 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 395/762] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:57 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 1328 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:13:57.371989 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1288f034-683e-475d-960f-c4b9325391f8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:57.373256 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1288f034-683e-475d-960f-c4b9325391f8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:57.380624 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1288f034-683e-475d-960f-c4b9325391f8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:57.381257 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1288f034-683e-475d-960f-c4b9325391f8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:57.382234 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1288f034-683e-475d-960f-c4b9325391f8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:57.382818 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1288f034-683e-475d-960f-c4b9325391f8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:57.509225 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1288f034-683e-475d-960f-c4b9325391f8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 200 len: 38370 microversion: 2.20 time: 0.140998 Dec 14 10:13:57.511117 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 396/763] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:13:57 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 38370 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:57.533799 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d991c2cb-748d-43fd-adde-1b3369be9af8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:57.534773 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d991c2cb-748d-43fd-adde-1b3369be9af8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:57.546676 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d991c2cb-748d-43fd-adde-1b3369be9af8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:57.547422 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d991c2cb-748d-43fd-adde-1b3369be9af8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:57.548562 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d991c2cb-748d-43fd-adde-1b3369be9af8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:57.549148 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d991c2cb-748d-43fd-adde-1b3369be9af8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:57.630912 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d991c2cb-748d-43fd-adde-1b3369be9af8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/ips" status: 200 len: 152 microversion: 2.20 time: 0.113776 Dec 14 10:13:57.631809 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 397/764] 10.222.0.20 () {60 vars in 1288 bytes} [Tue Dec 14 10:13:57 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/ips => generated 152 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:13:57.780584 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-81049288-386e-4470-a162-1f5620106433 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:57.782048 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-81049288-386e-4470-a162-1f5620106433 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:57.797894 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-81049288-386e-4470-a162-1f5620106433 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:57.798842 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-81049288-386e-4470-a162-1f5620106433 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:57.800007 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-81049288-386e-4470-a162-1f5620106433 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:57.802147 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-81049288-386e-4470-a162-1f5620106433 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:58.082667 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-81049288-386e-4470-a162-1f5620106433 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:58.092238 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-81049288-386e-4470-a162-1f5620106433 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1511 microversion: 2.1 time: 0.315839 Dec 14 10:13:58.094450 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 398/765] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:57 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1511 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:58.383096 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-63899471-7c60-4e44-aed4-550681b1bbfb tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:58.383985 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-63899471-7c60-4e44-aed4-550681b1bbfb tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:58.397817 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-63899471-7c60-4e44-aed4-550681b1bbfb tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:58.398351 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-63899471-7c60-4e44-aed4-550681b1bbfb tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:58.399631 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-63899471-7c60-4e44-aed4-550681b1bbfb tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:58.401260 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-63899471-7c60-4e44-aed4-550681b1bbfb tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:58.403605 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-dbad902a-a7e1-479b-a66c-8000b0ad8588 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:58.419796 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-dbad902a-a7e1-479b-a66c-8000b0ad8588 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1265 microversion: 2.1 time: 1.479645 Dec 14 10:13:58.421254 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 368/766] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:56 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1265 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:58.503366 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-63899471-7c60-4e44-aed4-550681b1bbfb tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] HTTP exception thrown: Instance 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f could not be found. Dec 14 10:13:58.504097 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-63899471-7c60-4e44-aed4-550681b1bbfb tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Returning 404 to user: Instance 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:13:58.504943 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-63899471-7c60-4e44-aed4-550681b1bbfb tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 404 len: 111 microversion: 2.1 time: 0.125609 Dec 14 10:13:58.505812 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 399/767] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:58 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 14 10:13:58.519109 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f6200a48-9eb8-421e-9946-443e0748acbd tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '.version_select at 0x7fb17a645790>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:58.554914 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f6200a48-9eb8-421e-9946-443e0748acbd tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1263408341" status: 202 len: 0 microversion: 2.1 time: 0.043854 Dec 14 10:13:58.562787 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 369/768] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Dec 14 10:13:58 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1263408341 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:13:58.892888 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-b23bcd89-07f0-4fbb-96ad-8589e2ef22f8 req-1d6c5f79-dc72-46f7-a845-d613a93b82f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b8c891-6fe6-4b09-8254-77c354e67aaa", "name": "network-vif-deleted", "tag": "35d84917-4bee-46b2-a5e4-3ff2c82add1c"}, {"name": "network-changed", "server_uuid": "fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6", "tag": "5a76754a-00ff-4c50-83e7-bc0e420e7c19"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:58.895359 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:13:58.895359 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:13:58.906904 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-b23bcd89-07f0-4fbb-96ad-8589e2ef22f8 req-1d6c5f79-dc72-46f7-a845-d613a93b82f7 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:58.907619 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-b23bcd89-07f0-4fbb-96ad-8589e2ef22f8 req-1d6c5f79-dc72-46f7-a845-d613a93b82f7 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:58.928974 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-b23bcd89-07f0-4fbb-96ad-8589e2ef22f8 req-1d6c5f79-dc72-46f7-a845-d613a93b82f7 service nova] Creating event network-vif-deleted:35d84917-4bee-46b2-a5e4-3ff2c82add1c for instance 12b8c891-6fe6-4b09-8254-77c354e67aaa on hv-cinder-81888 Dec 14 10:13:58.929473 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-b23bcd89-07f0-4fbb-96ad-8589e2ef22f8 req-1d6c5f79-dc72-46f7-a845-d613a93b82f7 service nova] Creating event network-changed:5a76754a-00ff-4c50-83e7-bc0e420e7c19 for instance fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 on hv-cinder-81888 Dec 14 10:13:58.936678 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-b23bcd89-07f0-4fbb-96ad-8589e2ef22f8 req-1d6c5f79-dc72-46f7-a845-d613a93b82f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.047807 Dec 14 10:13:58.937614 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 400/769] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:13:58 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:13:59.112188 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-85599e9b-4cb0-490b-b132-29bebfeec262 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:59.112865 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-85599e9b-4cb0-490b-b132-29bebfeec262 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:59.121696 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-85599e9b-4cb0-490b-b132-29bebfeec262 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:59.122195 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-85599e9b-4cb0-490b-b132-29bebfeec262 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:59.123044 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-85599e9b-4cb0-490b-b132-29bebfeec262 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:59.123661 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-85599e9b-4cb0-490b-b132-29bebfeec262 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:59.190473 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-85599e9b-4cb0-490b-b132-29bebfeec262 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:59.190926 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-85599e9b-4cb0-490b-b132-29bebfeec262 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:59.191376 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.objects.instance [None req-85599e9b-4cb0-490b-b132-29bebfeec262 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lazy-loading 'fault' on Instance uuid 12b8c891-6fe6-4b09-8254-77c354e67aaa {{(pid=100985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:13:59.263544 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-85599e9b-4cb0-490b-b132-29bebfeec262 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:59.271803 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-85599e9b-4cb0-490b-b132-29bebfeec262 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1348 microversion: 2.1 time: 0.163266 Dec 14 10:13:59.272272 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 370/770] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:59 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1348 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:59.437672 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c6c65a85-b648-4725-a612-eb788734e419 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:13:59.438528 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c6c65a85-b648-4725-a612-eb788734e419 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:13:59.446114 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c6c65a85-b648-4725-a612-eb788734e419 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:59.446650 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c6c65a85-b648-4725-a612-eb788734e419 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:59.447680 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c6c65a85-b648-4725-a612-eb788734e419 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:13:59.448205 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c6c65a85-b648-4725-a612-eb788734e419 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:13:59.808772 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c6c65a85-b648-4725-a612-eb788734e419 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:13:59.816864 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c6c65a85-b648-4725-a612-eb788734e419 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1265 microversion: 2.1 time: 0.383779 Dec 14 10:13:59.817656 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 401/771] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:13:59 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1265 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:13:59.865093 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c9e1e3a8-fa67-4da5-bb54-c4313174b721 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'create', calling method: .version_select at 0x7fb179aacca0>, body: {"keypair": {"name": "tempest-keypair-1517861628"}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:13:59.886702 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-c9e1e3a8-fa67-4da5-bb54-c4313174b721 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Getting quotas for project d66bc312475a4c749b82c1f077f8fff7. Resources: {'key_pairs'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:13:59.890479 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-c9e1e3a8-fa67-4da5-bb54-c4313174b721 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Getting quotas for user e2bd13a8087149c797727e140ec7d387 and project d66bc312475a4c749b82c1f077f8fff7. Resources: {'key_pairs'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:14:00.146042 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-c9e1e3a8-fa67-4da5-bb54-c4313174b721 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Getting quotas for project d66bc312475a4c749b82c1f077f8fff7. Resources: {'key_pairs'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:14:00.149571 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-c9e1e3a8-fa67-4da5-bb54-c4313174b721 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Getting quotas for user e2bd13a8087149c797727e140ec7d387 and project d66bc312475a4c749b82c1f077f8fff7. Resources: {'key_pairs'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:14:00.162181 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c9e1e3a8-fa67-4da5-bb54-c4313174b721 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.300832 Dec 14 10:14:00.162769 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 371/772] 10.222.0.20 () {60 vars in 1157 bytes} [Tue Dec 14 10:13:59 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:00.288423 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-095c5f17-022f-4359-8f40-e84892b64ee4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:00.289159 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-095c5f17-022f-4359-8f40-e84892b64ee4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:00.296428 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-095c5f17-022f-4359-8f40-e84892b64ee4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:00.296872 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-095c5f17-022f-4359-8f40-e84892b64ee4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:00.297634 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-095c5f17-022f-4359-8f40-e84892b64ee4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:00.298088 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-095c5f17-022f-4359-8f40-e84892b64ee4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:00.373809 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-095c5f17-022f-4359-8f40-e84892b64ee4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:00.374310 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-095c5f17-022f-4359-8f40-e84892b64ee4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:00.374771 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.objects.instance [None req-095c5f17-022f-4359-8f40-e84892b64ee4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lazy-loading 'fault' on Instance uuid 12b8c891-6fe6-4b09-8254-77c354e67aaa {{(pid=100984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:14:00.432779 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-095c5f17-022f-4359-8f40-e84892b64ee4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:00.440806 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-095c5f17-022f-4359-8f40-e84892b64ee4 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1348 microversion: 2.1 time: 0.155984 Dec 14 10:14:00.441374 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 402/773] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:00 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1348 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:00.833211 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-ae3d2508-cd4b-4785-aad2-30e7d21dde28 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:00.833823 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-ae3d2508-cd4b-4785-aad2-30e7d21dde28 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:00.841689 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ae3d2508-cd4b-4785-aad2-30e7d21dde28 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:00.842255 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ae3d2508-cd4b-4785-aad2-30e7d21dde28 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:00.843037 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ae3d2508-cd4b-4785-aad2-30e7d21dde28 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:00.843474 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ae3d2508-cd4b-4785-aad2-30e7d21dde28 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:01.203704 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-ae3d2508-cd4b-4785-aad2-30e7d21dde28 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:01.211658 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-ae3d2508-cd4b-4785-aad2-30e7d21dde28 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1265 microversion: 2.1 time: 0.382192 Dec 14 10:14:01.212232 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 372/774] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:00 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1265 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:01.457667 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d7b46edd-b944-48de-8e07-70befc80a4bd tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:01.458433 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d7b46edd-b944-48de-8e07-70befc80a4bd tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:01.466135 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d7b46edd-b944-48de-8e07-70befc80a4bd tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:01.466879 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d7b46edd-b944-48de-8e07-70befc80a4bd tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:01.467764 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d7b46edd-b944-48de-8e07-70befc80a4bd tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:01.468309 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d7b46edd-b944-48de-8e07-70befc80a4bd tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:01.547275 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d7b46edd-b944-48de-8e07-70befc80a4bd tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:01.547913 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d7b46edd-b944-48de-8e07-70befc80a4bd tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:01.548671 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.objects.instance [None req-d7b46edd-b944-48de-8e07-70befc80a4bd tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lazy-loading 'fault' on Instance uuid 12b8c891-6fe6-4b09-8254-77c354e67aaa {{(pid=100984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:14:01.611547 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d7b46edd-b944-48de-8e07-70befc80a4bd tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5aa925da1c459aac12363343f6d7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb4616940ba4338a7eaf7b0a17e974a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:01.620391 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d7b46edd-b944-48de-8e07-70befc80a4bd tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 200 len: 1348 microversion: 2.1 time: 0.166474 Dec 14 10:14:01.621050 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 403/775] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:01 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 1348 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:02.227708 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a14c7242-d5e1-41cd-90c2-637c2a5cd6ac tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:02.228458 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a14c7242-d5e1-41cd-90c2-637c2a5cd6ac tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:02.236351 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a14c7242-d5e1-41cd-90c2-637c2a5cd6ac tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:02.236504 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a14c7242-d5e1-41cd-90c2-637c2a5cd6ac tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:02.237161 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a14c7242-d5e1-41cd-90c2-637c2a5cd6ac tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:02.237591 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a14c7242-d5e1-41cd-90c2-637c2a5cd6ac tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:02.372152 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-3998c613-ff46-410e-b359-ff9116d98395 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:02.372748 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-3998c613-ff46-410e-b359-ff9116d98395 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:02.379896 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3998c613-ff46-410e-b359-ff9116d98395 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:02.380344 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3998c613-ff46-410e-b359-ff9116d98395 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:02.381093 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3998c613-ff46-410e-b359-ff9116d98395 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:02.381515 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3998c613-ff46-410e-b359-ff9116d98395 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:02.438984 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.objects.instance [None req-3998c613-ff46-410e-b359-ff9116d98395 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lazy-loading 'flavor' on Instance uuid 457d8e04-7e43-4287-8640-efedad40515d {{(pid=100984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:14:02.604174 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-a14c7242-d5e1-41cd-90c2-637c2a5cd6ac tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:02.613527 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a14c7242-d5e1-41cd-90c2-637c2a5cd6ac tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1265 microversion: 2.1 time: 0.389450 Dec 14 10:14:02.615132 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 373/776] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:02 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1265 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:02.623804 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f8a3b8a2-319e-4fe0-8506-f2274fcc222f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1494907116", "imageRef": "5be36fdc-2baa-4efd-b830-5a5c3fd7beba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33aca229-a8a6-4405-be53-80fe67a86208"}], "security_groups": [{"name": "tempest-securitygroup--376948085"}], "key_name": "tempest-keypair-1517861628", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:02.806190 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.network.neutron [None req-f8a3b8a2-319e-4fe0-8506-f2274fcc222f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] validate_networks() for [('33aca229-a8a6-4405-be53-80fe67a86208', None, None, None)] {{(pid=100985) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:14:02.815794 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-3998c613-ff46-410e-b359-ff9116d98395 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 202 len: 0 microversion: 2.20 time: 0.447541 Dec 14 10:14:02.817020 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 404/777] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:14:02 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 14 10:14:02.823247 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-450e0609-b935-4538-aacc-2f2ba9a25483 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:02.824181 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-450e0609-b935-4538-aacc-2f2ba9a25483 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] [instance: 12b8c891-6fe6-4b09-8254-77c354e67aaa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:02.832697 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-450e0609-b935-4538-aacc-2f2ba9a25483 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:02.833255 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-450e0609-b935-4538-aacc-2f2ba9a25483 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:02.834104 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-450e0609-b935-4538-aacc-2f2ba9a25483 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:02.834645 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-450e0609-b935-4538-aacc-2f2ba9a25483 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:02.889565 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-450e0609-b935-4538-aacc-2f2ba9a25483 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] HTTP exception thrown: Instance 12b8c891-6fe6-4b09-8254-77c354e67aaa could not be found. Dec 14 10:14:02.890222 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-450e0609-b935-4538-aacc-2f2ba9a25483 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Returning 404 to user: Instance 12b8c891-6fe6-4b09-8254-77c354e67aaa could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:14:02.891174 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-450e0609-b935-4538-aacc-2f2ba9a25483 tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa" status: 404 len: 111 microversion: 2.1 time: 0.072801 Dec 14 10:14:02.891736 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 405/778] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:02 2021] GET /compute/v2.1/servers/12b8c891-6fe6-4b09-8254-77c354e67aaa => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:14:02.896311 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-86621f1a-e447-482a-86d3-c6b44e8b6a93 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:02.896964 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-86621f1a-e447-482a-86d3-c6b44e8b6a93 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:02.905519 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-86621f1a-e447-482a-86d3-c6b44e8b6a93 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:02.905985 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-86621f1a-e447-482a-86d3-c6b44e8b6a93 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:02.906812 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-86621f1a-e447-482a-86d3-c6b44e8b6a93 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:02.907267 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-86621f1a-e447-482a-86d3-c6b44e8b6a93 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:03.111774 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-86621f1a-e447-482a-86d3-c6b44e8b6a93 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:03.123709 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-86621f1a-e447-482a-86d3-c6b44e8b6a93 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:03.125180 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-86621f1a-e447-482a-86d3-c6b44e8b6a93 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:03.126511 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-86621f1a-e447-482a-86d3-c6b44e8b6a93 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1720 microversion: 2.20 time: 0.233407 Dec 14 10:14:03.127078 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 406/779] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:02 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1720 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:03.131050 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a6993a4d-0a44-4352-a4e5-8b22ed09fe6e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] Calling method '.version_select at 0x7fb17913e160>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:03.150262 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a6993a4d-0a44-4352-a4e5-8b22ed09fe6e tempest-TestMinimumBasicScenario-467215313 tempest-TestMinimumBasicScenario-467215313-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1209786059" status: 202 len: 0 microversion: 2.1 time: 0.021949 Dec 14 10:14:03.150960 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 407/780] 10.222.0.20 () {58 vars in 1271 bytes} [Tue Dec 14 10:14:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1209786059 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:14:03.603966 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-f8a3b8a2-319e-4fe0-8506-f2274fcc222f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Flavor limits 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:14:03.604696 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-f8a3b8a2-319e-4fe0-8506-f2274fcc222f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Image limits 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:14:03.605328 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-f8a3b8a2-319e-4fe0-8506-f2274fcc222f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Flavor pref 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:14:03.605942 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-f8a3b8a2-319e-4fe0-8506-f2274fcc222f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Image pref 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:14:03.606506 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-f8a3b8a2-319e-4fe0-8506-f2274fcc222f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:14:03.616501 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f8a3b8a2-319e-4fe0-8506-f2274fcc222f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:03.617159 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f8a3b8a2-319e-4fe0-8506-f2274fcc222f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:03.618174 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f8a3b8a2-319e-4fe0-8506-f2274fcc222f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:03.619180 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f8a3b8a2-319e-4fe0-8506-f2274fcc222f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:03.632499 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e8e0ca1e-bbc1-4271-be5c-2bab7920b80b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:03.633274 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e8e0ca1e-bbc1-4271-be5c-2bab7920b80b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:03.638212 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-f8a3b8a2-319e-4fe0-8506-f2274fcc222f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Getting quotas for project d66bc312475a4c749b82c1f077f8fff7. Resources: {'cores', 'instances', 'ram'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:14:03.641037 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e8e0ca1e-bbc1-4271-be5c-2bab7920b80b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:03.641489 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e8e0ca1e-bbc1-4271-be5c-2bab7920b80b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:03.642261 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-f8a3b8a2-319e-4fe0-8506-f2274fcc222f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Getting quotas for user e2bd13a8087149c797727e140ec7d387 and project d66bc312475a4c749b82c1f077f8fff7. Resources: {'cores', 'instances', 'ram'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:14:03.642396 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e8e0ca1e-bbc1-4271-be5c-2bab7920b80b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:03.642745 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e8e0ca1e-bbc1-4271-be5c-2bab7920b80b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:03.655095 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f8a3b8a2-319e-4fe0-8506-f2274fcc222f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Going to run 1 instances... {{(pid=100985) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:14:03.657425 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f8a3b8a2-319e-4fe0-8506-f2274fcc222f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5be36fdc-2baa-4efd-b830-5a5c3fd7beba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:14:03.704135 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f8a3b8a2-319e-4fe0-8506-f2274fcc222f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.087718 Dec 14 10:14:03.710904 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 374/781] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Dec 14 10:14:02 2021] POST /compute/v2.1/servers => generated 401 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 10:14:03.716259 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-0f0d71b4-bf83-476b-9dd7-8cd38433cf72 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:03.717152 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-0f0d71b4-bf83-476b-9dd7-8cd38433cf72 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:03.833356 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-0f0d71b4-bf83-476b-9dd7-8cd38433cf72 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:03.847785 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-0f0d71b4-bf83-476b-9dd7-8cd38433cf72 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43" status: 200 len: 1238 microversion: 2.1 time: 0.134415 Dec 14 10:14:03.849053 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 375/782] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:03 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43 => generated 1238 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:03.888919 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e8e0ca1e-bbc1-4271-be5c-2bab7920b80b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:03.897717 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e8e0ca1e-bbc1-4271-be5c-2bab7920b80b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1265 microversion: 2.1 time: 0.269614 Dec 14 10:14:03.898311 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 408/783] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:03 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:14:04.148240 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-1b37b70d-3e3b-4e80-9e5b-7eee74482fb3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:04.149221 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-1b37b70d-3e3b-4e80-9e5b-7eee74482fb3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:04.162366 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1b37b70d-3e3b-4e80-9e5b-7eee74482fb3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:04.164641 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1b37b70d-3e3b-4e80-9e5b-7eee74482fb3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:04.166669 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1b37b70d-3e3b-4e80-9e5b-7eee74482fb3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:04.167134 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1b37b70d-3e3b-4e80-9e5b-7eee74482fb3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:04.531286 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-1b37b70d-3e3b-4e80-9e5b-7eee74482fb3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:04.539841 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-1b37b70d-3e3b-4e80-9e5b-7eee74482fb3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:04.541664 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-1b37b70d-3e3b-4e80-9e5b-7eee74482fb3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:04.542878 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-1b37b70d-3e3b-4e80-9e5b-7eee74482fb3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1720 microversion: 2.20 time: 0.401082 Dec 14 10:14:04.543430 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 376/784] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:04 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1720 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:04.866091 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d3dbe694-d387-4fe5-94bb-4bc96a769595 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:04.867073 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d3dbe694-d387-4fe5-94bb-4bc96a769595 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:04.874742 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d3dbe694-d387-4fe5-94bb-4bc96a769595 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:04.875031 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d3dbe694-d387-4fe5-94bb-4bc96a769595 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:04.875874 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d3dbe694-d387-4fe5-94bb-4bc96a769595 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:04.876305 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d3dbe694-d387-4fe5-94bb-4bc96a769595 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:04.916125 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-bdee19b0-9471-4ddc-b48c-e8ec915be921 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:04.917864 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-bdee19b0-9471-4ddc-b48c-e8ec915be921 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:04.925253 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bdee19b0-9471-4ddc-b48c-e8ec915be921 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:04.925942 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bdee19b0-9471-4ddc-b48c-e8ec915be921 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:04.926926 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bdee19b0-9471-4ddc-b48c-e8ec915be921 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:04.927354 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bdee19b0-9471-4ddc-b48c-e8ec915be921 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:05.053164 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d3dbe694-d387-4fe5-94bb-4bc96a769595 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:05.062785 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d3dbe694-d387-4fe5-94bb-4bc96a769595 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43" status: 200 len: 1308 microversion: 2.1 time: 0.200504 Dec 14 10:14:05.072753 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 409/785] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:04 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43 => generated 1308 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:14:05.561179 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d1d604b4-aba9-4cf8-a4f1-4b0882f88362 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:05.562085 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d1d604b4-aba9-4cf8-a4f1-4b0882f88362 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:05.571249 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d1d604b4-aba9-4cf8-a4f1-4b0882f88362 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:05.572827 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d1d604b4-aba9-4cf8-a4f1-4b0882f88362 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:05.573721 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d1d604b4-aba9-4cf8-a4f1-4b0882f88362 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:05.574297 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d1d604b4-aba9-4cf8-a4f1-4b0882f88362 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:05.605883 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-bdee19b0-9471-4ddc-b48c-e8ec915be921 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:05.622352 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-bdee19b0-9471-4ddc-b48c-e8ec915be921 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1265 microversion: 2.1 time: 0.710258 Dec 14 10:14:05.623248 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 377/786] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:04 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1265 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:05.887743 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d1d604b4-aba9-4cf8-a4f1-4b0882f88362 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:05.904348 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d1d604b4-aba9-4cf8-a4f1-4b0882f88362 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:05.905964 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d1d604b4-aba9-4cf8-a4f1-4b0882f88362 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:05.907200 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d1d604b4-aba9-4cf8-a4f1-4b0882f88362 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1720 microversion: 2.20 time: 0.350302 Dec 14 10:14:05.918240 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 410/787] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:05 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1720 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:06.080054 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-1bbcc702-ba55-4858-a3b6-e96ceba2ed29 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:06.080719 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-1bbcc702-ba55-4858-a3b6-e96ceba2ed29 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:06.088565 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1bbcc702-ba55-4858-a3b6-e96ceba2ed29 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:06.089020 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1bbcc702-ba55-4858-a3b6-e96ceba2ed29 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:06.089821 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1bbcc702-ba55-4858-a3b6-e96ceba2ed29 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:06.090307 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1bbcc702-ba55-4858-a3b6-e96ceba2ed29 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:06.248356 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-1bbcc702-ba55-4858-a3b6-e96ceba2ed29 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:06.256874 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-1bbcc702-ba55-4858-a3b6-e96ceba2ed29 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43" status: 200 len: 1296 microversion: 2.1 time: 0.180676 Dec 14 10:14:06.257523 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 378/788] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:06 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43 => generated 1296 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:06.639513 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-64520428-e12b-455f-b469-1e884384c866 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:06.640759 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-64520428-e12b-455f-b469-1e884384c866 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:06.648602 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-64520428-e12b-455f-b469-1e884384c866 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:06.649138 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-64520428-e12b-455f-b469-1e884384c866 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:06.650633 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-64520428-e12b-455f-b469-1e884384c866 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:06.651265 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-64520428-e12b-455f-b469-1e884384c866 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:06.864772 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-64520428-e12b-455f-b469-1e884384c866 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:06.873607 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-64520428-e12b-455f-b469-1e884384c866 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1265 microversion: 2.1 time: 0.238172 Dec 14 10:14:06.874555 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 411/789] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:06 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:06.925595 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-318b3efc-8471-4dff-b8c2-00b3373d27df tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:06.926491 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-318b3efc-8471-4dff-b8c2-00b3373d27df tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:06.934580 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-318b3efc-8471-4dff-b8c2-00b3373d27df tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:06.935333 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-318b3efc-8471-4dff-b8c2-00b3373d27df tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:06.936495 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-318b3efc-8471-4dff-b8c2-00b3373d27df tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:06.937008 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-318b3efc-8471-4dff-b8c2-00b3373d27df tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:07.275581 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-2086bf59-2f59-4365-9aa2-244b06f4ddfc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:07.276281 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-2086bf59-2f59-4365-9aa2-244b06f4ddfc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:07.283575 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2086bf59-2f59-4365-9aa2-244b06f4ddfc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:07.284271 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2086bf59-2f59-4365-9aa2-244b06f4ddfc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:07.285051 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2086bf59-2f59-4365-9aa2-244b06f4ddfc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:07.285501 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2086bf59-2f59-4365-9aa2-244b06f4ddfc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:07.499648 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-2086bf59-2f59-4365-9aa2-244b06f4ddfc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:07.507753 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-2086bf59-2f59-4365-9aa2-244b06f4ddfc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43" status: 200 len: 1363 microversion: 2.1 time: 0.236811 Dec 14 10:14:07.517659 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 412/790] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:07 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:07.549759 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-318b3efc-8471-4dff-b8c2-00b3373d27df tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:07.561017 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-318b3efc-8471-4dff-b8c2-00b3373d27df tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:07.563013 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-318b3efc-8471-4dff-b8c2-00b3373d27df tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:07.564203 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-318b3efc-8471-4dff-b8c2-00b3373d27df tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1720 microversion: 2.20 time: 0.642644 Dec 14 10:14:07.564762 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 379/791] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:06 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1720 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:07.890602 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-62772975-fac2-4d08-b019-d1f83d2eae7c tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:07.891222 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-62772975-fac2-4d08-b019-d1f83d2eae7c tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:07.898706 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-62772975-fac2-4d08-b019-d1f83d2eae7c tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:07.899091 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-62772975-fac2-4d08-b019-d1f83d2eae7c tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:07.900585 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-62772975-fac2-4d08-b019-d1f83d2eae7c tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:07.901108 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-62772975-fac2-4d08-b019-d1f83d2eae7c tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:08.100775 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-62772975-fac2-4d08-b019-d1f83d2eae7c tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:08.110440 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-62772975-fac2-4d08-b019-d1f83d2eae7c tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1265 microversion: 2.1 time: 0.223492 Dec 14 10:14:08.111012 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 413/792] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:07 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:08.527341 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e2141941-8630-4699-900b-4e49186a834c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:08.527922 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e2141941-8630-4699-900b-4e49186a834c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:08.559683 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e2141941-8630-4699-900b-4e49186a834c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:08.560260 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e2141941-8630-4699-900b-4e49186a834c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:08.560916 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e2141941-8630-4699-900b-4e49186a834c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:08.561356 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e2141941-8630-4699-900b-4e49186a834c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:08.583086 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-cf6a449d-0532-4611-b6fe-e4324aa09874 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:08.584148 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-cf6a449d-0532-4611-b6fe-e4324aa09874 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:08.597318 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cf6a449d-0532-4611-b6fe-e4324aa09874 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:08.604537 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cf6a449d-0532-4611-b6fe-e4324aa09874 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:08.606879 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cf6a449d-0532-4611-b6fe-e4324aa09874 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:08.607592 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cf6a449d-0532-4611-b6fe-e4324aa09874 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:09.165291 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-e2141941-8630-4699-900b-4e49186a834c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:09.174319 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e2141941-8630-4699-900b-4e49186a834c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43" status: 200 len: 1363 microversion: 2.1 time: 0.652112 Dec 14 10:14:09.175213 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 380/793] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:08 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43 => generated 1363 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:09.182822 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-28735988-a68f-4a7e-9582-8cbd8ac809dd req-89b2223f-cff9-45be-b8ce-f7e80865ce84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d877f71b-46a2-42d5-9289-8bc4752e2f43", "tag": "12b65534-dfb7-42d4-8669-166c24dd76e5"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:09.184969 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:14:09.184969 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:14:09.193150 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-cf6a449d-0532-4611-b6fe-e4324aa09874 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:09.196022 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-28735988-a68f-4a7e-9582-8cbd8ac809dd req-89b2223f-cff9-45be-b8ce-f7e80865ce84 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:09.197554 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-28735988-a68f-4a7e-9582-8cbd8ac809dd req-89b2223f-cff9-45be-b8ce-f7e80865ce84 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:09.203060 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-cf6a449d-0532-4611-b6fe-e4324aa09874 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:09.205202 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-cf6a449d-0532-4611-b6fe-e4324aa09874 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:09.206275 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-cf6a449d-0532-4611-b6fe-e4324aa09874 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1720 microversion: 2.20 time: 0.626844 Dec 14 10:14:09.218401 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 414/794] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:08 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1720 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:09.219282 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-28735988-a68f-4a7e-9582-8cbd8ac809dd req-89b2223f-cff9-45be-b8ce-f7e80865ce84 service nova] Creating event network-changed:12b65534-dfb7-42d4-8669-166c24dd76e5 for instance d877f71b-46a2-42d5-9289-8bc4752e2f43 on hv-cinder-81888 Dec 14 10:14:09.226714 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-7d581ebb-16a5-4746-be34-36bf30a37c3b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:09.227340 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-7d581ebb-16a5-4746-be34-36bf30a37c3b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:09.229697 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-28735988-a68f-4a7e-9582-8cbd8ac809dd req-89b2223f-cff9-45be-b8ce-f7e80865ce84 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052650 Dec 14 10:14:09.230873 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 381/795] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:14:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:14:09.235528 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7d581ebb-16a5-4746-be34-36bf30a37c3b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:09.235977 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7d581ebb-16a5-4746-be34-36bf30a37c3b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:09.236759 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7d581ebb-16a5-4746-be34-36bf30a37c3b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:09.237199 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7d581ebb-16a5-4746-be34-36bf30a37c3b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:09.577599 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-7d581ebb-16a5-4746-be34-36bf30a37c3b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:09.589105 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-7d581ebb-16a5-4746-be34-36bf30a37c3b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1265 microversion: 2.1 time: 0.369607 Dec 14 10:14:09.589894 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 415/796] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:09 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1265 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:10.195292 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-78db35f1-5417-41f7-a935-3535f0c1ff33 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:10.196083 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-78db35f1-5417-41f7-a935-3535f0c1ff33 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:10.204188 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-78db35f1-5417-41f7-a935-3535f0c1ff33 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:10.204704 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-78db35f1-5417-41f7-a935-3535f0c1ff33 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:10.205494 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-78db35f1-5417-41f7-a935-3535f0c1ff33 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:10.205925 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-78db35f1-5417-41f7-a935-3535f0c1ff33 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:10.224311 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-bce2c887-6256-41dc-b0d5-02a072ce9b76 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:10.224917 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-bce2c887-6256-41dc-b0d5-02a072ce9b76 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:10.238087 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bce2c887-6256-41dc-b0d5-02a072ce9b76 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:10.239363 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bce2c887-6256-41dc-b0d5-02a072ce9b76 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:10.241138 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bce2c887-6256-41dc-b0d5-02a072ce9b76 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:10.241928 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bce2c887-6256-41dc-b0d5-02a072ce9b76 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:10.606602 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-bce2c887-6256-41dc-b0d5-02a072ce9b76 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:10.621257 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-bce2c887-6256-41dc-b0d5-02a072ce9b76 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:10.631596 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-bce2c887-6256-41dc-b0d5-02a072ce9b76 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:10.633254 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-bce2c887-6256-41dc-b0d5-02a072ce9b76 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1720 microversion: 2.20 time: 0.412443 Dec 14 10:14:10.645572 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 416/797] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:10 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1720 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:14:10.651599 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-60a86117-bb59-4167-8ecd-d43229d87c38 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:10.652543 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-60a86117-bb59-4167-8ecd-d43229d87c38 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:10.660949 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-60a86117-bb59-4167-8ecd-d43229d87c38 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:10.661523 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-60a86117-bb59-4167-8ecd-d43229d87c38 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:10.662421 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-60a86117-bb59-4167-8ecd-d43229d87c38 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:10.662934 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-60a86117-bb59-4167-8ecd-d43229d87c38 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:10.686598 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-78db35f1-5417-41f7-a935-3535f0c1ff33 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:10.694706 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-78db35f1-5417-41f7-a935-3535f0c1ff33 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43" status: 200 len: 1363 microversion: 2.1 time: 0.503874 Dec 14 10:14:10.695284 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 382/798] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:10 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43 => generated 1363 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:11.047700 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-60a86117-bb59-4167-8ecd-d43229d87c38 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:11.061467 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-60a86117-bb59-4167-8ecd-d43229d87c38 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1265 microversion: 2.1 time: 0.413268 Dec 14 10:14:11.063893 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 417/799] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:10 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1265 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:11.653315 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-ff48bff3-714f-4186-b5b9-55a3a5a2b730 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:11.654048 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-ff48bff3-714f-4186-b5b9-55a3a5a2b730 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:11.661971 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ff48bff3-714f-4186-b5b9-55a3a5a2b730 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:11.662506 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ff48bff3-714f-4186-b5b9-55a3a5a2b730 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:11.673761 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ff48bff3-714f-4186-b5b9-55a3a5a2b730 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:11.674548 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ff48bff3-714f-4186-b5b9-55a3a5a2b730 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:11.711394 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-719b42f4-8c56-4026-a852-dc73f240470b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:11.712904 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-719b42f4-8c56-4026-a852-dc73f240470b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:11.720255 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-719b42f4-8c56-4026-a852-dc73f240470b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:11.720732 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-719b42f4-8c56-4026-a852-dc73f240470b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:11.721592 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-719b42f4-8c56-4026-a852-dc73f240470b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:11.722145 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-719b42f4-8c56-4026-a852-dc73f240470b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:11.916514 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-719b42f4-8c56-4026-a852-dc73f240470b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:11.924773 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-719b42f4-8c56-4026-a852-dc73f240470b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43" status: 200 len: 1363 microversion: 2.1 time: 0.217041 Dec 14 10:14:11.925336 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 418/800] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:11 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:14:12.079779 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-582682e8-4682-46b7-8dcf-7242b66f91f4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:12.080415 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-582682e8-4682-46b7-8dcf-7242b66f91f4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:12.087956 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-582682e8-4682-46b7-8dcf-7242b66f91f4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:12.088398 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-582682e8-4682-46b7-8dcf-7242b66f91f4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:12.089163 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-582682e8-4682-46b7-8dcf-7242b66f91f4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:12.089593 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-582682e8-4682-46b7-8dcf-7242b66f91f4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:12.114502 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-ff48bff3-714f-4186-b5b9-55a3a5a2b730 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:12.124025 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-ff48bff3-714f-4186-b5b9-55a3a5a2b730 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:12.125685 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-ff48bff3-714f-4186-b5b9-55a3a5a2b730 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:12.127082 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-ff48bff3-714f-4186-b5b9-55a3a5a2b730 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1720 microversion: 2.20 time: 0.478550 Dec 14 10:14:12.127737 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 383/801] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:11 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1720 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:12.377046 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-582682e8-4682-46b7-8dcf-7242b66f91f4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:12.385314 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-582682e8-4682-46b7-8dcf-7242b66f91f4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1265 microversion: 2.1 time: 0.309271 Dec 14 10:14:12.385879 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 419/802] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:12 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1265 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:14:12.941400 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a46b34ca-13d8-4171-84ee-1941db995711 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:12.942200 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a46b34ca-13d8-4171-84ee-1941db995711 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:12.951113 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a46b34ca-13d8-4171-84ee-1941db995711 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:12.951727 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a46b34ca-13d8-4171-84ee-1941db995711 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:12.952618 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a46b34ca-13d8-4171-84ee-1941db995711 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:12.953147 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a46b34ca-13d8-4171-84ee-1941db995711 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:13.145433 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c3646c0f-c88d-4f9e-95ff-75fcfacf5f36 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:13.146089 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c3646c0f-c88d-4f9e-95ff-75fcfacf5f36 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:13.153829 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c3646c0f-c88d-4f9e-95ff-75fcfacf5f36 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:13.154300 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c3646c0f-c88d-4f9e-95ff-75fcfacf5f36 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:13.155057 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c3646c0f-c88d-4f9e-95ff-75fcfacf5f36 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:13.155480 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c3646c0f-c88d-4f9e-95ff-75fcfacf5f36 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:13.292830 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-a46b34ca-13d8-4171-84ee-1941db995711 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:13.301409 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a46b34ca-13d8-4171-84ee-1941db995711 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43" status: 200 len: 1363 microversion: 2.1 time: 0.363903 Dec 14 10:14:13.302144 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 384/803] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:12 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43 => generated 1363 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:13.367544 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c3646c0f-c88d-4f9e-95ff-75fcfacf5f36 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:13.376958 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c3646c0f-c88d-4f9e-95ff-75fcfacf5f36 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:13.378924 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c3646c0f-c88d-4f9e-95ff-75fcfacf5f36 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:13.380337 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c3646c0f-c88d-4f9e-95ff-75fcfacf5f36 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1720 microversion: 2.20 time: 0.238579 Dec 14 10:14:13.381209 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 420/804] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:13 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1720 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:14:13.402091 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-7f6d3fe8-5d96-42b0-a5c1-10d8a6669d59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:13.402921 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-7f6d3fe8-5d96-42b0-a5c1-10d8a6669d59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:13.410410 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7f6d3fe8-5d96-42b0-a5c1-10d8a6669d59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:13.410867 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7f6d3fe8-5d96-42b0-a5c1-10d8a6669d59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:13.411652 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7f6d3fe8-5d96-42b0-a5c1-10d8a6669d59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:13.412154 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7f6d3fe8-5d96-42b0-a5c1-10d8a6669d59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:13.804847 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-7f6d3fe8-5d96-42b0-a5c1-10d8a6669d59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:13.814851 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-7f6d3fe8-5d96-42b0-a5c1-10d8a6669d59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1265 microversion: 2.1 time: 0.416610 Dec 14 10:14:13.824598 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 385/805] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:13 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1265 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:14.159298 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-3748a48c-67ec-465a-983d-bea73543ccf7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:14.160078 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-3748a48c-67ec-465a-983d-bea73543ccf7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:14.168445 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3748a48c-67ec-465a-983d-bea73543ccf7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:14.168888 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3748a48c-67ec-465a-983d-bea73543ccf7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:14.169664 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3748a48c-67ec-465a-983d-bea73543ccf7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:14.170135 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3748a48c-67ec-465a-983d-bea73543ccf7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:14.225534 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.objects.instance [None req-3748a48c-67ec-465a-983d-bea73543ccf7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lazy-loading 'flavor' on Instance uuid 731c99da-4633-4de9-9678-02e9fecda7b4 {{(pid=100984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:14:14.318822 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e3539b9f-df44-4c89-b401-f8d6ad76ef9f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:14.320019 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e3539b9f-df44-4c89-b401-f8d6ad76ef9f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:14.327328 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e3539b9f-df44-4c89-b401-f8d6ad76ef9f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:14.327773 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e3539b9f-df44-4c89-b401-f8d6ad76ef9f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:14.328710 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e3539b9f-df44-4c89-b401-f8d6ad76ef9f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:14.329302 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e3539b9f-df44-4c89-b401-f8d6ad76ef9f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:14.384037 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-3748a48c-67ec-465a-983d-bea73543ccf7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "POST /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4/action" status: 202 len: 0 microversion: 2.1 time: 0.227890 Dec 14 10:14:14.385662 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 421/806] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:14 2021] POST /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:14:14.396244 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-fdcca604-b62a-4e61-b11d-e4d1d85f247b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:14.397820 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-fdcca604-b62a-4e61-b11d-e4d1d85f247b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:14.410742 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fdcca604-b62a-4e61-b11d-e4d1d85f247b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:14.411854 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fdcca604-b62a-4e61-b11d-e4d1d85f247b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:14.413023 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fdcca604-b62a-4e61-b11d-e4d1d85f247b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:14.413677 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fdcca604-b62a-4e61-b11d-e4d1d85f247b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:14.727954 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-fdcca604-b62a-4e61-b11d-e4d1d85f247b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:14.736928 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-fdcca604-b62a-4e61-b11d-e4d1d85f247b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1568 microversion: 2.1 time: 0.346139 Dec 14 10:14:14.737988 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 422/807] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:14 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1568 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:14:14.742172 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-3caf612f-b3a9-4051-a0af-0ab2547bb1d0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:14.742771 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-3caf612f-b3a9-4051-a0af-0ab2547bb1d0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:14.750285 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3caf612f-b3a9-4051-a0af-0ab2547bb1d0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:14.750729 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3caf612f-b3a9-4051-a0af-0ab2547bb1d0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:14.751500 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3caf612f-b3a9-4051-a0af-0ab2547bb1d0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:14.751926 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3caf612f-b3a9-4051-a0af-0ab2547bb1d0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:14.890403 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-e3539b9f-df44-4c89-b401-f8d6ad76ef9f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:14.903280 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e3539b9f-df44-4c89-b401-f8d6ad76ef9f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43" status: 200 len: 1363 microversion: 2.1 time: 0.586900 Dec 14 10:14:14.906076 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 386/808] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:14 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43 => generated 1363 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:14:15.013456 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-3caf612f-b3a9-4051-a0af-0ab2547bb1d0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:15.027893 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-3caf612f-b3a9-4051-a0af-0ab2547bb1d0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:15.029400 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-3caf612f-b3a9-4051-a0af-0ab2547bb1d0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:15.030575 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-3caf612f-b3a9-4051-a0af-0ab2547bb1d0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1741 microversion: 2.20 time: 0.291785 Dec 14 10:14:15.032434 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 423/809] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:14 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1741 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:15.037135 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-46f40b5d-267b-4839-875a-0f6be9d55f82 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:15.037939 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-46f40b5d-267b-4839-875a-0f6be9d55f82 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:15.051208 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-46f40b5d-267b-4839-875a-0f6be9d55f82 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:15.051661 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-46f40b5d-267b-4839-875a-0f6be9d55f82 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:15.052454 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-46f40b5d-267b-4839-875a-0f6be9d55f82 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:15.052891 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-46f40b5d-267b-4839-875a-0f6be9d55f82 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:15.312660 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-46f40b5d-267b-4839-875a-0f6be9d55f82 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:15.314518 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-1dc13733-774f-4633-ba12-ced947fcb197 req-4ebc9776-dc32-4e27-a557-4af02932d74c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d877f71b-46a2-42d5-9289-8bc4752e2f43", "name": "network-vif-plugged", "status": "completed", "tag": "12b65534-dfb7-42d4-8669-166c24dd76e5"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:15.316569 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:14:15.316569 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:14:15.323171 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-46f40b5d-267b-4839-875a-0f6be9d55f82 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1265 microversion: 2.1 time: 0.289532 Dec 14 10:14:15.324552 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 424/810] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:15 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1265 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:15.335625 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-1dc13733-774f-4633-ba12-ced947fcb197 req-4ebc9776-dc32-4e27-a557-4af02932d74c service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:15.337228 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-1dc13733-774f-4633-ba12-ced947fcb197 req-4ebc9776-dc32-4e27-a557-4af02932d74c service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:15.355280 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-1dc13733-774f-4633-ba12-ced947fcb197 req-4ebc9776-dc32-4e27-a557-4af02932d74c service nova] Creating event network-vif-plugged:12b65534-dfb7-42d4-8669-166c24dd76e5 for instance d877f71b-46a2-42d5-9289-8bc4752e2f43 on hv-cinder-81888 Dec 14 10:14:15.360657 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-1dc13733-774f-4633-ba12-ced947fcb197 req-4ebc9776-dc32-4e27-a557-4af02932d74c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.449436 Dec 14 10:14:15.361621 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 387/811] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:14:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:14:15.753313 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-3d3ca9a9-7705-43a8-8500-c8f617119497 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:15.754041 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-3d3ca9a9-7705-43a8-8500-c8f617119497 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:15.762741 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3d3ca9a9-7705-43a8-8500-c8f617119497 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:15.763289 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3d3ca9a9-7705-43a8-8500-c8f617119497 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:15.764156 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3d3ca9a9-7705-43a8-8500-c8f617119497 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:15.764890 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3d3ca9a9-7705-43a8-8500-c8f617119497 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:15.924830 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-53ed0890-80ca-4107-ba34-76d265420dda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:15.925456 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-53ed0890-80ca-4107-ba34-76d265420dda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:15.933706 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-53ed0890-80ca-4107-ba34-76d265420dda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:15.934466 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-53ed0890-80ca-4107-ba34-76d265420dda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:15.935392 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-53ed0890-80ca-4107-ba34-76d265420dda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:15.935830 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-53ed0890-80ca-4107-ba34-76d265420dda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:16.046507 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-3d3ca9a9-7705-43a8-8500-c8f617119497 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:16.055948 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-3d3ca9a9-7705-43a8-8500-c8f617119497 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1568 microversion: 2.1 time: 0.306111 Dec 14 10:14:16.056831 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 425/812] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:15 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:16.070755 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-317d0fb8-88cf-4676-b7cc-7bc61f26bd79 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:16.071496 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-317d0fb8-88cf-4676-b7cc-7bc61f26bd79 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:16.093120 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-317d0fb8-88cf-4676-b7cc-7bc61f26bd79 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:16.093756 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-317d0fb8-88cf-4676-b7cc-7bc61f26bd79 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:16.095392 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-317d0fb8-88cf-4676-b7cc-7bc61f26bd79 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:16.096281 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-317d0fb8-88cf-4676-b7cc-7bc61f26bd79 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:16.420896 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-317d0fb8-88cf-4676-b7cc-7bc61f26bd79 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:16.436637 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-317d0fb8-88cf-4676-b7cc-7bc61f26bd79 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:16.438490 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-317d0fb8-88cf-4676-b7cc-7bc61f26bd79 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:16.439839 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-317d0fb8-88cf-4676-b7cc-7bc61f26bd79 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1736 microversion: 2.20 time: 0.372781 Dec 14 10:14:16.452896 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 426/813] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:16 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1736 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:16.460927 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-397f9013-4846-475f-820b-90da13a390ab tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:16.466267 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-397f9013-4846-475f-820b-90da13a390ab tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:16.475187 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-397f9013-4846-475f-820b-90da13a390ab tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:16.475892 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-397f9013-4846-475f-820b-90da13a390ab tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:16.476865 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-397f9013-4846-475f-820b-90da13a390ab tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:16.477494 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-397f9013-4846-475f-820b-90da13a390ab tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:16.776345 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-397f9013-4846-475f-820b-90da13a390ab tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:16.786470 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-397f9013-4846-475f-820b-90da13a390ab tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1265 microversion: 2.1 time: 0.332171 Dec 14 10:14:16.788034 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 427/814] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:16 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1265 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:17.073378 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e141a0ee-1b0e-48f2-b1fa-ea1a9d8b392e tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:17.074184 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e141a0ee-1b0e-48f2-b1fa-ea1a9d8b392e tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:17.086102 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e141a0ee-1b0e-48f2-b1fa-ea1a9d8b392e tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:17.086923 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e141a0ee-1b0e-48f2-b1fa-ea1a9d8b392e tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:17.099001 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e141a0ee-1b0e-48f2-b1fa-ea1a9d8b392e tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:17.099753 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e141a0ee-1b0e-48f2-b1fa-ea1a9d8b392e tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:17.228175 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-53ed0890-80ca-4107-ba34-76d265420dda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:17.245100 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-53ed0890-80ca-4107-ba34-76d265420dda tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43" status: 200 len: 1363 microversion: 2.1 time: 1.327419 Dec 14 10:14:17.259505 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 388/815] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:15 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43 => generated 1363 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:17.377791 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-1ea42a93-a78b-4255-ab34-7970b30ddd97 req-ee9c8d4e-2e24-42a3-b76f-3d99b94b9541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6", "name": "network-vif-plugged", "status": "completed", "tag": "5a76754a-00ff-4c50-83e7-bc0e420e7c19"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:17.379612 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:14:17.379612 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:14:17.398441 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-1ea42a93-a78b-4255-ab34-7970b30ddd97 req-ee9c8d4e-2e24-42a3-b76f-3d99b94b9541 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:17.400199 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-1ea42a93-a78b-4255-ab34-7970b30ddd97 req-ee9c8d4e-2e24-42a3-b76f-3d99b94b9541 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:17.422534 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-1ea42a93-a78b-4255-ab34-7970b30ddd97 req-ee9c8d4e-2e24-42a3-b76f-3d99b94b9541 service nova] Creating event network-vif-plugged:5a76754a-00ff-4c50-83e7-bc0e420e7c19 for instance fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 on hv-cinder-81888 Dec 14 10:14:17.427616 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-1ea42a93-a78b-4255-ab34-7970b30ddd97 req-ee9c8d4e-2e24-42a3-b76f-3d99b94b9541 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054157 Dec 14 10:14:17.428882 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 389/816] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:14:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:14:17.459833 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-0716833a-0cce-40cd-8a3d-de734fa7c806 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:17.460622 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-0716833a-0cce-40cd-8a3d-de734fa7c806 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:17.480781 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0716833a-0cce-40cd-8a3d-de734fa7c806 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:17.483535 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0716833a-0cce-40cd-8a3d-de734fa7c806 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:17.484394 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0716833a-0cce-40cd-8a3d-de734fa7c806 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:17.484875 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0716833a-0cce-40cd-8a3d-de734fa7c806 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:17.608423 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e141a0ee-1b0e-48f2-b1fa-ea1a9d8b392e tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:17.619302 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e141a0ee-1b0e-48f2-b1fa-ea1a9d8b392e tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1568 microversion: 2.1 time: 0.549595 Dec 14 10:14:17.630820 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 428/817] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:17 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1568 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:14:17.810158 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-db80a459-3389-466a-970c-7f2049293cbe tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:17.811189 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-db80a459-3389-466a-970c-7f2049293cbe tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:17.824902 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-db80a459-3389-466a-970c-7f2049293cbe tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:17.825728 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-db80a459-3389-466a-970c-7f2049293cbe tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:17.829408 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-db80a459-3389-466a-970c-7f2049293cbe tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:17.830770 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-db80a459-3389-466a-970c-7f2049293cbe tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:18.124265 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-db80a459-3389-466a-970c-7f2049293cbe tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:18.133834 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-db80a459-3389-466a-970c-7f2049293cbe tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1265 microversion: 2.1 time: 0.333157 Dec 14 10:14:18.134922 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 429/818] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:17 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1265 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:14:18.272751 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-7d71adec-5c92-4e12-821f-de427cf7ad73 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:18.275564 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-7d71adec-5c92-4e12-821f-de427cf7ad73 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:18.295133 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-0716833a-0cce-40cd-8a3d-de734fa7c806 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:18.307841 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7d71adec-5c92-4e12-821f-de427cf7ad73 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:18.308518 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7d71adec-5c92-4e12-821f-de427cf7ad73 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:18.309484 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7d71adec-5c92-4e12-821f-de427cf7ad73 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:18.310222 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7d71adec-5c92-4e12-821f-de427cf7ad73 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:18.320691 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-0716833a-0cce-40cd-8a3d-de734fa7c806 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:18.322796 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-0716833a-0cce-40cd-8a3d-de734fa7c806 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:18.324643 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-0716833a-0cce-40cd-8a3d-de734fa7c806 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1736 microversion: 2.20 time: 0.868543 Dec 14 10:14:18.325393 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 390/819] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:17 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1736 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:14:18.650192 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-d62805e2-a41f-4ff7-9bd2-f6576a6770c1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:18.651321 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-d62805e2-a41f-4ff7-9bd2-f6576a6770c1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:18.681743 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d62805e2-a41f-4ff7-9bd2-f6576a6770c1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:18.683534 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d62805e2-a41f-4ff7-9bd2-f6576a6770c1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:18.684547 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d62805e2-a41f-4ff7-9bd2-f6576a6770c1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:18.685179 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d62805e2-a41f-4ff7-9bd2-f6576a6770c1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:18.842955 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-7d71adec-5c92-4e12-821f-de427cf7ad73 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:18.851826 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-7d71adec-5c92-4e12-821f-de427cf7ad73 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43" status: 200 len: 1549 microversion: 2.1 time: 0.587068 Dec 14 10:14:18.870920 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 430/820] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:18 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43 => generated 1549 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:18.878160 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-db238fc4-1e53-49a2-a19c-7dd4920f662f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:18.878660 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-db238fc4-1e53-49a2-a19c-7dd4920f662f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:18.903191 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-db238fc4-1e53-49a2-a19c-7dd4920f662f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:18.903630 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-db238fc4-1e53-49a2-a19c-7dd4920f662f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:18.904414 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-db238fc4-1e53-49a2-a19c-7dd4920f662f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:18.904844 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-db238fc4-1e53-49a2-a19c-7dd4920f662f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:19.019233 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-d62805e2-a41f-4ff7-9bd2-f6576a6770c1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:19.031076 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-d62805e2-a41f-4ff7-9bd2-f6576a6770c1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1568 microversion: 2.1 time: 0.391510 Dec 14 10:14:19.040294 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 391/821] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:18 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1568 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:19.153161 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a3faf1f7-9452-450a-8047-171c0d91647b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:19.154099 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a3faf1f7-9452-450a-8047-171c0d91647b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:19.163264 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a3faf1f7-9452-450a-8047-171c0d91647b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:19.163985 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a3faf1f7-9452-450a-8047-171c0d91647b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:19.166197 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a3faf1f7-9452-450a-8047-171c0d91647b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:19.167320 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a3faf1f7-9452-450a-8047-171c0d91647b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:19.609179 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-db238fc4-1e53-49a2-a19c-7dd4920f662f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.737034 Dec 14 10:14:19.610069 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 431/822] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Dec 14 10:14:18 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-interface => generated 285 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:14:19.616219 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-65b98464-9d1a-4654-93d6-4ffe907d5b39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:19.617112 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-65b98464-9d1a-4654-93d6-4ffe907d5b39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:19.636301 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-65b98464-9d1a-4654-93d6-4ffe907d5b39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:19.636932 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-65b98464-9d1a-4654-93d6-4ffe907d5b39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:19.644646 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-65b98464-9d1a-4654-93d6-4ffe907d5b39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:19.645260 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-65b98464-9d1a-4654-93d6-4ffe907d5b39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:19.684070 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-a3faf1f7-9452-450a-8047-171c0d91647b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:19.693318 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a3faf1f7-9452-450a-8047-171c0d91647b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1265 microversion: 2.1 time: 0.545780 Dec 14 10:14:19.694227 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 392/823] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:19 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1265 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:14:19.698732 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-6bb32e8d-9c4e-4434-9030-01ff2718e27c req-9cdd3304-fec7-45ad-a1a6-867293db6a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "457d8e04-7e43-4287-8640-efedad40515d", "name": "network-vif-plugged", "status": "completed", "tag": "07c89ab1-3f66-4963-95e3-1048fc17638b"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:19.700293 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:14:19.700293 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:14:19.708718 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-6bb32e8d-9c4e-4434-9030-01ff2718e27c req-9cdd3304-fec7-45ad-a1a6-867293db6a81 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:19.709160 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-6bb32e8d-9c4e-4434-9030-01ff2718e27c req-9cdd3304-fec7-45ad-a1a6-867293db6a81 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:19.738544 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-6bb32e8d-9c4e-4434-9030-01ff2718e27c req-9cdd3304-fec7-45ad-a1a6-867293db6a81 service nova] Creating event network-vif-plugged:07c89ab1-3f66-4963-95e3-1048fc17638b for instance 457d8e04-7e43-4287-8640-efedad40515d on hv-cinder-81888 Dec 14 10:14:19.745506 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-6bb32e8d-9c4e-4434-9030-01ff2718e27c req-9cdd3304-fec7-45ad-a1a6-867293db6a81 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050100 Dec 14 10:14:19.748414 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 393/824] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:14:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:14:20.056201 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-2eeda9b7-9f93-4cd8-b784-47856595d5e1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:20.057070 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-2eeda9b7-9f93-4cd8-b784-47856595d5e1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:20.075512 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2eeda9b7-9f93-4cd8-b784-47856595d5e1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:20.076237 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2eeda9b7-9f93-4cd8-b784-47856595d5e1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:20.076956 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2eeda9b7-9f93-4cd8-b784-47856595d5e1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:20.077487 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2eeda9b7-9f93-4cd8-b784-47856595d5e1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:20.348428 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-2eeda9b7-9f93-4cd8-b784-47856595d5e1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:20.359164 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-2eeda9b7-9f93-4cd8-b784-47856595d5e1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1568 microversion: 2.1 time: 0.307186 Dec 14 10:14:20.359745 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 394/825] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:20 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1568 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:20.515421 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-65b98464-9d1a-4654-93d6-4ffe907d5b39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:20.528724 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-65b98464-9d1a-4654-93d6-4ffe907d5b39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:20.530958 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-65b98464-9d1a-4654-93d6-4ffe907d5b39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:20.532294 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-65b98464-9d1a-4654-93d6-4ffe907d5b39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1736 microversion: 2.20 time: 0.921118 Dec 14 10:14:20.533328 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 432/826] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:19 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1736 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:20.718964 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b82ff532-8eda-4077-bb5d-7129ff619664 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:20.719867 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-b82ff532-8eda-4077-bb5d-7129ff619664 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:20.747776 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b82ff532-8eda-4077-bb5d-7129ff619664 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:20.753903 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b82ff532-8eda-4077-bb5d-7129ff619664 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:20.755308 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b82ff532-8eda-4077-bb5d-7129ff619664 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:20.756072 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b82ff532-8eda-4077-bb5d-7129ff619664 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:21.173066 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-b82ff532-8eda-4077-bb5d-7129ff619664 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:21.185436 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-b82ff532-8eda-4077-bb5d-7129ff619664 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1452 microversion: 2.1 time: 0.478975 Dec 14 10:14:21.187234 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 395/827] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:20 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1452 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:21.203691 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-63b6e7ce-37c6-4f26-ba7b-ea69b9b4b889 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:21.204307 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-63b6e7ce-37c6-4f26-ba7b-ea69b9b4b889 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:21.214875 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-63b6e7ce-37c6-4f26-ba7b-ea69b9b4b889 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:21.215608 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-63b6e7ce-37c6-4f26-ba7b-ea69b9b4b889 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:21.217118 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-63b6e7ce-37c6-4f26-ba7b-ea69b9b4b889 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:21.217880 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-63b6e7ce-37c6-4f26-ba7b-ea69b9b4b889 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:21.377907 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-4db764c5-9446-4b26-beb9-34cfa4fe40fa tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:21.378875 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-4db764c5-9446-4b26-beb9-34cfa4fe40fa tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:21.387642 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4db764c5-9446-4b26-beb9-34cfa4fe40fa tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:21.388390 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4db764c5-9446-4b26-beb9-34cfa4fe40fa tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:21.389502 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4db764c5-9446-4b26-beb9-34cfa4fe40fa tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:21.390125 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4db764c5-9446-4b26-beb9-34cfa4fe40fa tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:21.644187 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-4db764c5-9446-4b26-beb9-34cfa4fe40fa tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:21.655330 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-4db764c5-9446-4b26-beb9-34cfa4fe40fa tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1568 microversion: 2.1 time: 0.281805 Dec 14 10:14:21.665341 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 396/828] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:21 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1568 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:14:21.665341 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-17fe1a5f-6de1-433d-bd14-d0320776836c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:21.665341 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-17fe1a5f-6de1-433d-bd14-d0320776836c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:21.673594 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-17fe1a5f-6de1-433d-bd14-d0320776836c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:21.674156 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-17fe1a5f-6de1-433d-bd14-d0320776836c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:21.678083 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-17fe1a5f-6de1-433d-bd14-d0320776836c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:21.678719 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-17fe1a5f-6de1-433d-bd14-d0320776836c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:21.772808 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-63b6e7ce-37c6-4f26-ba7b-ea69b9b4b889 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:21.791400 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-63b6e7ce-37c6-4f26-ba7b-ea69b9b4b889 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1452 microversion: 2.1 time: 0.588039 Dec 14 10:14:21.804361 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 433/829] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:21 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1452 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:21.995387 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-17fe1a5f-6de1-433d-bd14-d0320776836c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:22.006807 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-17fe1a5f-6de1-433d-bd14-d0320776836c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:22.012161 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-17fe1a5f-6de1-433d-bd14-d0320776836c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:22.016229 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-17fe1a5f-6de1-433d-bd14-d0320776836c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1736 microversion: 2.20 time: 0.357186 Dec 14 10:14:22.017221 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 397/830] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:21 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1736 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:22.251189 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-56672102-a76d-4816-83ec-5794da223126 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:22.252612 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-56672102-a76d-4816-83ec-5794da223126 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:22.266986 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-56672102-a76d-4816-83ec-5794da223126 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:22.275524 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-56672102-a76d-4816-83ec-5794da223126 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:22.283194 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-56672102-a76d-4816-83ec-5794da223126 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:22.283868 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-56672102-a76d-4816-83ec-5794da223126 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:22.381087 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-305a8d48-9f7c-4fb5-82bd-712de6a6ea67 req-93078a1e-bc6b-4df8-afba-8bca6e68a7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d877f71b-46a2-42d5-9289-8bc4752e2f43", "tag": "12b65534-dfb7-42d4-8669-166c24dd76e5"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:22.382739 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:14:22.382739 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:14:22.395715 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-305a8d48-9f7c-4fb5-82bd-712de6a6ea67 req-93078a1e-bc6b-4df8-afba-8bca6e68a7f7 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:22.396515 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-305a8d48-9f7c-4fb5-82bd-712de6a6ea67 req-93078a1e-bc6b-4df8-afba-8bca6e68a7f7 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:22.437691 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-305a8d48-9f7c-4fb5-82bd-712de6a6ea67 req-93078a1e-bc6b-4df8-afba-8bca6e68a7f7 service nova] Creating event network-changed:12b65534-dfb7-42d4-8669-166c24dd76e5 for instance d877f71b-46a2-42d5-9289-8bc4752e2f43 on hv-cinder-81888 Dec 14 10:14:22.461246 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-305a8d48-9f7c-4fb5-82bd-712de6a6ea67 req-93078a1e-bc6b-4df8-afba-8bca6e68a7f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089515 Dec 14 10:14:22.461882 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 398/831] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:14:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Dec 14 10:14:22.497970 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-56672102-a76d-4816-83ec-5794da223126 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 14 microversion: 2.1 time: 0.250174 Dec 14 10:14:22.498802 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 434/832] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:22 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 14 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 14 10:14:22.674475 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-13e02096-36db-4959-b503-28e03f1c077d tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:22.674910 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-13e02096-36db-4959-b503-28e03f1c077d tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:22.686298 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-13e02096-36db-4959-b503-28e03f1c077d tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:22.686786 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-13e02096-36db-4959-b503-28e03f1c077d tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:22.687573 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-13e02096-36db-4959-b503-28e03f1c077d tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:22.688012 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-13e02096-36db-4959-b503-28e03f1c077d tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:23.037570 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-979fbc1f-9377-43a0-a9a4-28f970b1a29f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:23.040660 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-979fbc1f-9377-43a0-a9a4-28f970b1a29f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:23.058153 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-979fbc1f-9377-43a0-a9a4-28f970b1a29f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:23.058875 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-979fbc1f-9377-43a0-a9a4-28f970b1a29f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:23.060219 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-979fbc1f-9377-43a0-a9a4-28f970b1a29f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:23.066345 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-979fbc1f-9377-43a0-a9a4-28f970b1a29f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:23.412958 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-13e02096-36db-4959-b503-28e03f1c077d tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:23.424299 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-13e02096-36db-4959-b503-28e03f1c077d tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1568 microversion: 2.1 time: 0.755155 Dec 14 10:14:23.428515 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 399/833] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:22 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1568 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:23.509523 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-86fd57bc-297d-4bb6-b50e-f9d7d4fabd48 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:23.510796 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-86fd57bc-297d-4bb6-b50e-f9d7d4fabd48 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:23.530171 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-86fd57bc-297d-4bb6-b50e-f9d7d4fabd48 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:23.530990 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-86fd57bc-297d-4bb6-b50e-f9d7d4fabd48 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:23.532007 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-86fd57bc-297d-4bb6-b50e-f9d7d4fabd48 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:23.532616 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-86fd57bc-297d-4bb6-b50e-f9d7d4fabd48 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:23.692400 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-86fd57bc-297d-4bb6-b50e-f9d7d4fabd48 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 14 microversion: 2.1 time: 0.186523 Dec 14 10:14:23.693647 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 400/834] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:23 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 14 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 10:14:24.068673 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-979fbc1f-9377-43a0-a9a4-28f970b1a29f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:24.081589 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-979fbc1f-9377-43a0-a9a4-28f970b1a29f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:24.083103 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-979fbc1f-9377-43a0-a9a4-28f970b1a29f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:24.087726 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-979fbc1f-9377-43a0-a9a4-28f970b1a29f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1736 microversion: 2.20 time: 1.055322 Dec 14 10:14:24.102898 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 435/835] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:23 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1736 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:24.460833 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-16e31557-ad2d-4be0-aad2-867c30a29566 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:24.464087 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-16e31557-ad2d-4be0-aad2-867c30a29566 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:24.480619 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-16e31557-ad2d-4be0-aad2-867c30a29566 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:24.481486 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-16e31557-ad2d-4be0-aad2-867c30a29566 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:24.482556 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-16e31557-ad2d-4be0-aad2-867c30a29566 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:24.483198 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-16e31557-ad2d-4be0-aad2-867c30a29566 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:24.704711 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d7483645-14eb-4124-af33-cfa7a64818c8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:24.706517 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d7483645-14eb-4124-af33-cfa7a64818c8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:24.716057 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d7483645-14eb-4124-af33-cfa7a64818c8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:24.716758 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d7483645-14eb-4124-af33-cfa7a64818c8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:24.717714 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d7483645-14eb-4124-af33-cfa7a64818c8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:24.718327 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d7483645-14eb-4124-af33-cfa7a64818c8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:24.854350 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d7483645-14eb-4124-af33-cfa7a64818c8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 14 microversion: 2.1 time: 0.153026 Dec 14 10:14:24.855717 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 436/836] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:24 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 14 10:14:25.109778 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-388c1618-68b4-4c7a-a250-181000388b1b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:25.111238 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-388c1618-68b4-4c7a-a250-181000388b1b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:25.113360 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-16e31557-ad2d-4be0-aad2-867c30a29566 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:25.120448 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-388c1618-68b4-4c7a-a250-181000388b1b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:25.121700 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-388c1618-68b4-4c7a-a250-181000388b1b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:25.121984 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-16e31557-ad2d-4be0-aad2-867c30a29566 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1568 microversion: 2.1 time: 0.667544 Dec 14 10:14:25.122998 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-388c1618-68b4-4c7a-a250-181000388b1b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:25.123821 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-388c1618-68b4-4c7a-a250-181000388b1b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:25.140352 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 401/837] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:24 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1568 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:25.644233 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-388c1618-68b4-4c7a-a250-181000388b1b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:25.658645 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-388c1618-68b4-4c7a-a250-181000388b1b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:25.663457 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-388c1618-68b4-4c7a-a250-181000388b1b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:25.668534 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-388c1618-68b4-4c7a-a250-181000388b1b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1736 microversion: 2.20 time: 0.563600 Dec 14 10:14:25.670275 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 437/838] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:25 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1736 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:14:25.864814 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f6f59e96-8636-4ba9-8c2e-492d8263ae88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:25.865736 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f6f59e96-8636-4ba9-8c2e-492d8263ae88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:25.874102 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f6f59e96-8636-4ba9-8c2e-492d8263ae88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:25.874556 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f6f59e96-8636-4ba9-8c2e-492d8263ae88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:25.875595 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f6f59e96-8636-4ba9-8c2e-492d8263ae88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:25.876285 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f6f59e96-8636-4ba9-8c2e-492d8263ae88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:25.983723 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f6f59e96-8636-4ba9-8c2e-492d8263ae88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 14 microversion: 2.1 time: 0.122367 Dec 14 10:14:25.984975 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 402/839] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:25 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 10:14:26.147021 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e773afe8-e214-47e8-ba50-f4894352a015 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:26.147729 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e773afe8-e214-47e8-ba50-f4894352a015 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:26.162427 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e773afe8-e214-47e8-ba50-f4894352a015 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:26.163910 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e773afe8-e214-47e8-ba50-f4894352a015 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:26.166836 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e773afe8-e214-47e8-ba50-f4894352a015 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:26.167342 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e773afe8-e214-47e8-ba50-f4894352a015 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:26.204969 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-22c09877-799f-4f69-bdec-9502f0013d38 req-a0ffd788-2d3b-40e9-990e-585114d67471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6", "tag": "5a76754a-00ff-4c50-83e7-bc0e420e7c19"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:26.207277 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:14:26.207277 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:14:26.226160 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-22c09877-799f-4f69-bdec-9502f0013d38 req-a0ffd788-2d3b-40e9-990e-585114d67471 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:26.226944 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-22c09877-799f-4f69-bdec-9502f0013d38 req-a0ffd788-2d3b-40e9-990e-585114d67471 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:26.257782 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-22c09877-799f-4f69-bdec-9502f0013d38 req-a0ffd788-2d3b-40e9-990e-585114d67471 service nova] Creating event network-changed:5a76754a-00ff-4c50-83e7-bc0e420e7c19 for instance fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 on hv-cinder-81888 Dec 14 10:14:26.276304 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-22c09877-799f-4f69-bdec-9502f0013d38 req-a0ffd788-2d3b-40e9-990e-585114d67471 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075530 Dec 14 10:14:26.277552 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 403/840] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:14:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:14:26.482098 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e773afe8-e214-47e8-ba50-f4894352a015 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:26.496291 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e773afe8-e214-47e8-ba50-f4894352a015 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1568 microversion: 2.1 time: 0.353167 Dec 14 10:14:26.496967 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 438/841] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:26 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1568 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:26.688542 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-18933b64-77ca-468c-bc8c-d68460f395b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:26.689343 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-18933b64-77ca-468c-bc8c-d68460f395b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:26.697405 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-18933b64-77ca-468c-bc8c-d68460f395b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:26.698237 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-18933b64-77ca-468c-bc8c-d68460f395b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:26.699299 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-18933b64-77ca-468c-bc8c-d68460f395b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:26.699946 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-18933b64-77ca-468c-bc8c-d68460f395b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:26.995381 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-3fd1aa45-875c-47a9-94d0-4580b9bd68fd tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:26.996641 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-3fd1aa45-875c-47a9-94d0-4580b9bd68fd tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:27.022190 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3fd1aa45-875c-47a9-94d0-4580b9bd68fd tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:27.023171 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3fd1aa45-875c-47a9-94d0-4580b9bd68fd tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:27.024218 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3fd1aa45-875c-47a9-94d0-4580b9bd68fd tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:27.024911 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3fd1aa45-875c-47a9-94d0-4580b9bd68fd tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:27.069052 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-18933b64-77ca-468c-bc8c-d68460f395b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:27.083467 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-18933b64-77ca-468c-bc8c-d68460f395b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:27.089411 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-18933b64-77ca-468c-bc8c-d68460f395b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:27.094325 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-18933b64-77ca-468c-bc8c-d68460f395b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1736 microversion: 2.20 time: 0.409845 Dec 14 10:14:27.109838 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 404/842] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:26 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1736 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:27.166014 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-3fd1aa45-875c-47a9-94d0-4580b9bd68fd tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 14 microversion: 2.1 time: 0.174764 Dec 14 10:14:27.170365 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 439/843] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:26 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 14 10:14:27.514212 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-0935ab8f-64f5-4c0d-8578-492adf073906 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:27.515148 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-0935ab8f-64f5-4c0d-8578-492adf073906 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:27.529617 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0935ab8f-64f5-4c0d-8578-492adf073906 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:27.531340 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0935ab8f-64f5-4c0d-8578-492adf073906 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:27.532366 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0935ab8f-64f5-4c0d-8578-492adf073906 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:27.532965 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0935ab8f-64f5-4c0d-8578-492adf073906 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:27.893449 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-0935ab8f-64f5-4c0d-8578-492adf073906 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:27.905238 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-0935ab8f-64f5-4c0d-8578-492adf073906 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1568 microversion: 2.1 time: 0.394264 Dec 14 10:14:27.906819 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 405/844] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:27 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1568 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:28.116036 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a31a7a17-e528-475e-b306-36c760200680 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:28.117485 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-a31a7a17-e528-475e-b306-36c760200680 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:28.134687 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a31a7a17-e528-475e-b306-36c760200680 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:28.135123 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a31a7a17-e528-475e-b306-36c760200680 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:28.135906 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a31a7a17-e528-475e-b306-36c760200680 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:28.136332 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a31a7a17-e528-475e-b306-36c760200680 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:28.177938 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-2197c397-13aa-4aa9-9349-8f1efc64e9e5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:28.178891 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-2197c397-13aa-4aa9-9349-8f1efc64e9e5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:28.191427 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2197c397-13aa-4aa9-9349-8f1efc64e9e5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:28.191872 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2197c397-13aa-4aa9-9349-8f1efc64e9e5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:28.192710 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2197c397-13aa-4aa9-9349-8f1efc64e9e5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:28.193137 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2197c397-13aa-4aa9-9349-8f1efc64e9e5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:28.388379 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-2197c397-13aa-4aa9-9349-8f1efc64e9e5 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 14 microversion: 2.1 time: 0.214178 Dec 14 10:14:28.390021 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 406/845] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:28 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 14 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 10:14:28.415310 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-a31a7a17-e528-475e-b306-36c760200680 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:28.424830 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-a31a7a17-e528-475e-b306-36c760200680 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:28.426704 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-a31a7a17-e528-475e-b306-36c760200680 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:28.429872 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a31a7a17-e528-475e-b306-36c760200680 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1736 microversion: 2.20 time: 0.317333 Dec 14 10:14:28.431235 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 440/846] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:28 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1736 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:28.923864 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-1dee0ca3-4ddb-42c3-b7e2-af5e5aead4e8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:28.924719 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-1dee0ca3-4ddb-42c3-b7e2-af5e5aead4e8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:28.935852 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1dee0ca3-4ddb-42c3-b7e2-af5e5aead4e8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:28.936506 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1dee0ca3-4ddb-42c3-b7e2-af5e5aead4e8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:28.937443 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1dee0ca3-4ddb-42c3-b7e2-af5e5aead4e8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:28.938690 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1dee0ca3-4ddb-42c3-b7e2-af5e5aead4e8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:29.189867 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-1dee0ca3-4ddb-42c3-b7e2-af5e5aead4e8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:29.206488 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-1dee0ca3-4ddb-42c3-b7e2-af5e5aead4e8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1509 microversion: 2.1 time: 0.286354 Dec 14 10:14:29.207440 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 407/847] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:28 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1509 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:29.227407 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-9186177c-e140-46e9-bf52-4b2092df6664 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:29.228554 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-9186177c-e140-46e9-bf52-4b2092df6664 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:29.237030 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9186177c-e140-46e9-bf52-4b2092df6664 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:29.237485 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9186177c-e140-46e9-bf52-4b2092df6664 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:29.238533 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9186177c-e140-46e9-bf52-4b2092df6664 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:29.239177 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9186177c-e140-46e9-bf52-4b2092df6664 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:29.401376 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f946c7e9-c675-4a0e-af66-75c56213ce92 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:29.403272 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f946c7e9-c675-4a0e-af66-75c56213ce92 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:29.416616 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f946c7e9-c675-4a0e-af66-75c56213ce92 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:29.417230 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f946c7e9-c675-4a0e-af66-75c56213ce92 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:29.418052 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f946c7e9-c675-4a0e-af66-75c56213ce92 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:29.418489 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f946c7e9-c675-4a0e-af66-75c56213ce92 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:29.433568 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-9186177c-e140-46e9-bf52-4b2092df6664 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "POST /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4/action" status: 202 len: 0 microversion: 2.1 time: 0.210436 Dec 14 10:14:29.437573 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 441/848] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:29 2021] POST /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 14 10:14:29.443417 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-949ee9bb-cf69-49c3-bd73-8167de5f6415 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:29.443417 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-949ee9bb-cf69-49c3-bd73-8167de5f6415 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:29.451717 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-949ee9bb-cf69-49c3-bd73-8167de5f6415 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:29.452172 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-949ee9bb-cf69-49c3-bd73-8167de5f6415 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:29.452958 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-949ee9bb-cf69-49c3-bd73-8167de5f6415 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:29.453394 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-949ee9bb-cf69-49c3-bd73-8167de5f6415 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:29.552975 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f946c7e9-c675-4a0e-af66-75c56213ce92 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 14 microversion: 2.1 time: 0.154981 Dec 14 10:14:29.554442 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 408/849] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:29 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 14 10:14:29.562179 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-9aeea7f8-2416-4c83-9280-0fb9c9093464 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:29.564709 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-9aeea7f8-2416-4c83-9280-0fb9c9093464 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:29.584936 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9aeea7f8-2416-4c83-9280-0fb9c9093464 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:29.587177 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9aeea7f8-2416-4c83-9280-0fb9c9093464 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:29.588394 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9aeea7f8-2416-4c83-9280-0fb9c9093464 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:29.588834 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9aeea7f8-2416-4c83-9280-0fb9c9093464 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:29.665896 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-949ee9bb-cf69-49c3-bd73-8167de5f6415 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:29.676114 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-949ee9bb-cf69-49c3-bd73-8167de5f6415 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1517 microversion: 2.1 time: 0.237408 Dec 14 10:14:29.686937 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 442/850] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:29 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1517 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:29.888524 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-9aeea7f8-2416-4c83-9280-0fb9c9093464 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:29.897303 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-9aeea7f8-2416-4c83-9280-0fb9c9093464 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:29.898885 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-9aeea7f8-2416-4c83-9280-0fb9c9093464 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:29.900273 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-9aeea7f8-2416-4c83-9280-0fb9c9093464 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1736 microversion: 2.20 time: 0.343676 Dec 14 10:14:29.900869 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 409/851] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:29 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1736 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:30.564781 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a7b39908-7205-41ab-8b99-7be685e22a33 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:30.565700 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-a7b39908-7205-41ab-8b99-7be685e22a33 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:30.572949 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a7b39908-7205-41ab-8b99-7be685e22a33 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:30.573387 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a7b39908-7205-41ab-8b99-7be685e22a33 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:30.574265 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a7b39908-7205-41ab-8b99-7be685e22a33 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:30.575037 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a7b39908-7205-41ab-8b99-7be685e22a33 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:30.678260 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a7b39908-7205-41ab-8b99-7be685e22a33 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 7546 microversion: 2.1 time: 0.116931 Dec 14 10:14:30.678899 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 443/852] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:30 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 7546 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:30.694501 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-ba9764ed-4c0c-4997-ba0b-42f36fc206d1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:30.695112 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-ba9764ed-4c0c-4997-ba0b-42f36fc206d1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:30.702664 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ba9764ed-4c0c-4997-ba0b-42f36fc206d1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:30.703107 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ba9764ed-4c0c-4997-ba0b-42f36fc206d1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:30.704004 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ba9764ed-4c0c-4997-ba0b-42f36fc206d1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:30.704434 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ba9764ed-4c0c-4997-ba0b-42f36fc206d1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:30.919829 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-50839354-3df4-4dca-b561-1541c640d956 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:30.920615 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-50839354-3df4-4dca-b561-1541c640d956 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:30.928902 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-50839354-3df4-4dca-b561-1541c640d956 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:30.929643 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-50839354-3df4-4dca-b561-1541c640d956 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:30.930493 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-50839354-3df4-4dca-b561-1541c640d956 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:30.930977 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-50839354-3df4-4dca-b561-1541c640d956 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:31.053191 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-ba9764ed-4c0c-4997-ba0b-42f36fc206d1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:31.064620 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-ba9764ed-4c0c-4997-ba0b-42f36fc206d1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1519 microversion: 2.1 time: 0.373758 Dec 14 10:14:31.065592 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 410/853] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:30 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1519 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:31.146903 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-50839354-3df4-4dca-b561-1541c640d956 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:31.164287 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-50839354-3df4-4dca-b561-1541c640d956 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:31.165987 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-50839354-3df4-4dca-b561-1541c640d956 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:31.167146 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-50839354-3df4-4dca-b561-1541c640d956 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1718 microversion: 2.20 time: 0.252343 Dec 14 10:14:31.169995 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 444/854] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:30 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1718 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:31.690262 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-1b2fdddc-20a2-4e00-baed-103b04e71289 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:31.691176 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-1b2fdddc-20a2-4e00-baed-103b04e71289 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:31.698517 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1b2fdddc-20a2-4e00-baed-103b04e71289 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:31.699097 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1b2fdddc-20a2-4e00-baed-103b04e71289 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:31.699706 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1b2fdddc-20a2-4e00-baed-103b04e71289 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:31.700139 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1b2fdddc-20a2-4e00-baed-103b04e71289 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:31.803779 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-1b2fdddc-20a2-4e00-baed-103b04e71289 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 15025 microversion: 2.1 time: 0.117081 Dec 14 10:14:31.804407 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 411/855] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:31 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 15025 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:14:32.081890 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-6f309665-b3d7-4a14-9349-d941d1b1fc41 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:32.082533 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-6f309665-b3d7-4a14-9349-d941d1b1fc41 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:32.091335 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6f309665-b3d7-4a14-9349-d941d1b1fc41 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:32.091771 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6f309665-b3d7-4a14-9349-d941d1b1fc41 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:32.092535 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6f309665-b3d7-4a14-9349-d941d1b1fc41 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:32.092964 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6f309665-b3d7-4a14-9349-d941d1b1fc41 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:32.186417 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-58440eba-5976-472b-b063-9c5f8ec96acb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:32.187114 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-58440eba-5976-472b-b063-9c5f8ec96acb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:32.195006 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-58440eba-5976-472b-b063-9c5f8ec96acb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:32.195456 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-58440eba-5976-472b-b063-9c5f8ec96acb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:32.197187 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-58440eba-5976-472b-b063-9c5f8ec96acb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:32.197627 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-58440eba-5976-472b-b063-9c5f8ec96acb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:32.288747 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-6f309665-b3d7-4a14-9349-d941d1b1fc41 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:32.297399 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-6f309665-b3d7-4a14-9349-d941d1b1fc41 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1575 microversion: 2.1 time: 0.219164 Dec 14 10:14:32.297966 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 445/856] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:32 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1575 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:32.533093 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-58440eba-5976-472b-b063-9c5f8ec96acb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:32.542107 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-58440eba-5976-472b-b063-9c5f8ec96acb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:32.543649 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-58440eba-5976-472b-b063-9c5f8ec96acb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:32.544781 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-58440eba-5976-472b-b063-9c5f8ec96acb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1718 microversion: 2.20 time: 0.362616 Dec 14 10:14:32.545342 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 412/857] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:32 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1718 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:14:32.690816 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-a5b57b0c-638d-4abd-a9e0-9653d89a070f req-a67e5e18-a9c2-4ea4-ba27-a82ddbfcc2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731c99da-4633-4de9-9678-02e9fecda7b4", "name": "network-vif-unplugged", "status": "completed", "tag": "eb309f74-48d9-4eb5-98e8-7571414fa330"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:32.692688 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:14:32.692688 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:14:32.701982 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-a5b57b0c-638d-4abd-a9e0-9653d89a070f req-a67e5e18-a9c2-4ea4-ba27-a82ddbfcc2d5 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:32.702446 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-a5b57b0c-638d-4abd-a9e0-9653d89a070f req-a67e5e18-a9c2-4ea4-ba27-a82ddbfcc2d5 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:32.718085 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-a5b57b0c-638d-4abd-a9e0-9653d89a070f req-a67e5e18-a9c2-4ea4-ba27-a82ddbfcc2d5 service nova] Creating event network-vif-unplugged:eb309f74-48d9-4eb5-98e8-7571414fa330 for instance 731c99da-4633-4de9-9678-02e9fecda7b4 on hv-cinder-81888 Dec 14 10:14:32.722747 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-a5b57b0c-638d-4abd-a9e0-9653d89a070f req-a67e5e18-a9c2-4ea4-ba27-a82ddbfcc2d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035674 Dec 14 10:14:32.723674 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 446/858] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:14:32 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:14:32.815230 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3687ea5e-ff35-43b0-83c6-4c1cfc02e531 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:32.816185 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3687ea5e-ff35-43b0-83c6-4c1cfc02e531 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:32.823306 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3687ea5e-ff35-43b0-83c6-4c1cfc02e531 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:32.823749 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3687ea5e-ff35-43b0-83c6-4c1cfc02e531 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:32.824508 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3687ea5e-ff35-43b0-83c6-4c1cfc02e531 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:32.824935 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3687ea5e-ff35-43b0-83c6-4c1cfc02e531 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:32.934982 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3687ea5e-ff35-43b0-83c6-4c1cfc02e531 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 18206 microversion: 2.1 time: 0.123433 Dec 14 10:14:32.935589 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 413/859] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:32 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 18206 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:14:33.315321 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-377de233-7600-4d42-9db8-6b21cc781f62 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:33.316068 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-377de233-7600-4d42-9db8-6b21cc781f62 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:33.323383 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-377de233-7600-4d42-9db8-6b21cc781f62 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:33.323821 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-377de233-7600-4d42-9db8-6b21cc781f62 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:33.324570 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-377de233-7600-4d42-9db8-6b21cc781f62 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:33.324991 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-377de233-7600-4d42-9db8-6b21cc781f62 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:33.526120 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-377de233-7600-4d42-9db8-6b21cc781f62 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:33.535565 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-377de233-7600-4d42-9db8-6b21cc781f62 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1575 microversion: 2.1 time: 0.224190 Dec 14 10:14:33.536139 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 447/860] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:33 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:33.563692 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-ccdc1ff7-49cd-49ca-a485-af88b85a49b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:33.564335 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-ccdc1ff7-49cd-49ca-a485-af88b85a49b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:33.572918 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ccdc1ff7-49cd-49ca-a485-af88b85a49b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:33.573362 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ccdc1ff7-49cd-49ca-a485-af88b85a49b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:33.574161 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ccdc1ff7-49cd-49ca-a485-af88b85a49b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:33.574595 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ccdc1ff7-49cd-49ca-a485-af88b85a49b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:33.773529 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-ccdc1ff7-49cd-49ca-a485-af88b85a49b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:33.782384 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-ccdc1ff7-49cd-49ca-a485-af88b85a49b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:33.783899 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-ccdc1ff7-49cd-49ca-a485-af88b85a49b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:33.785017 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-ccdc1ff7-49cd-49ca-a485-af88b85a49b0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1661 microversion: 2.20 time: 0.225570 Dec 14 10:14:33.785563 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 414/861] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:33 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1661 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:33.802460 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-543217d0-1662-474a-9f12-8f616b019ea4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f73c61cc-84e0-46b9-b743-25cb2b3200af"}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:33.803490 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-543217d0-1662-474a-9f12-8f616b019ea4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:33.811360 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-543217d0-1662-474a-9f12-8f616b019ea4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:33.811795 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-543217d0-1662-474a-9f12-8f616b019ea4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:33.812546 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-543217d0-1662-474a-9f12-8f616b019ea4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:33.812964 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-543217d0-1662-474a-9f12-8f616b019ea4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:33.947031 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-73a40813-f3d1-4229-87f6-334cb40263e7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:33.948073 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-73a40813-f3d1-4229-87f6-334cb40263e7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:33.955096 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-73a40813-f3d1-4229-87f6-334cb40263e7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:33.955536 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-73a40813-f3d1-4229-87f6-334cb40263e7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:33.956301 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-73a40813-f3d1-4229-87f6-334cb40263e7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:33.956719 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-73a40813-f3d1-4229-87f6-334cb40263e7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:34.062024 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-73a40813-f3d1-4229-87f6-334cb40263e7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 19539 microversion: 2.1 time: 0.119110 Dec 14 10:14:34.065704 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 415/862] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:33 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 19539 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:14:34.225382 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-543217d0-1662-474a-9f12-8f616b019ea4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.426634 Dec 14 10:14:34.226011 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 448/863] 10.222.0.20 () {62 vars in 1363 bytes} [Tue Dec 14 10:14:33 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/os-volume_attachments => generated 188 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:14:34.396062 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-5f5b3c8e-1416-4250-8eff-5c19964cd8e7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:34.396716 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-5f5b3c8e-1416-4250-8eff-5c19964cd8e7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:34.405315 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5f5b3c8e-1416-4250-8eff-5c19964cd8e7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:34.405763 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5f5b3c8e-1416-4250-8eff-5c19964cd8e7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:34.406583 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5f5b3c8e-1416-4250-8eff-5c19964cd8e7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:34.407023 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5f5b3c8e-1416-4250-8eff-5c19964cd8e7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:34.552460 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f3aea6e3-9954-4ee2-8a47-d5d90569f3e1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:34.553062 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f3aea6e3-9954-4ee2-8a47-d5d90569f3e1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:34.559149 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-5f5b3c8e-1416-4250-8eff-5c19964cd8e7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action" status: 202 len: 0 microversion: 2.20 time: 0.167024 Dec 14 10:14:34.560068 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 416/864] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:14:34 2021] POST /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 14 10:14:34.567498 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-bfb7c3cf-c3b1-49d5-8b5e-cf2472912561 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:34.568192 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-bfb7c3cf-c3b1-49d5-8b5e-cf2472912561 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:34.576261 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bfb7c3cf-c3b1-49d5-8b5e-cf2472912561 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:34.576718 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bfb7c3cf-c3b1-49d5-8b5e-cf2472912561 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:34.578164 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bfb7c3cf-c3b1-49d5-8b5e-cf2472912561 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:34.578616 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bfb7c3cf-c3b1-49d5-8b5e-cf2472912561 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:34.579134 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f3aea6e3-9954-4ee2-8a47-d5d90569f3e1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:34.579583 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f3aea6e3-9954-4ee2-8a47-d5d90569f3e1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:34.580359 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f3aea6e3-9954-4ee2-8a47-d5d90569f3e1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:34.580782 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f3aea6e3-9954-4ee2-8a47-d5d90569f3e1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:34.804298 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-bfb7c3cf-c3b1-49d5-8b5e-cf2472912561 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:34.814480 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-bfb7c3cf-c3b1-49d5-8b5e-cf2472912561 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:34.816143 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-bfb7c3cf-c3b1-49d5-8b5e-cf2472912561 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:34.817370 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-bfb7c3cf-c3b1-49d5-8b5e-cf2472912561 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1747 microversion: 2.20 time: 0.253499 Dec 14 10:14:34.818240 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 417/865] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:34 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1747 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:14:34.823474 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-9519d1d7-61e8-4444-922a-97417f7d3576 req-e879986d-9d08-4455-b545-e86393aaec20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "457d8e04-7e43-4287-8640-efedad40515d", "name": "network-vif-unplugged", "status": "completed", "tag": "07c89ab1-3f66-4963-95e3-1048fc17638b"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:34.825044 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:14:34.825044 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:14:34.830744 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-f3aea6e3-9954-4ee2-8a47-d5d90569f3e1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:34.833322 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-9519d1d7-61e8-4444-922a-97417f7d3576 req-e879986d-9d08-4455-b545-e86393aaec20 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:34.833838 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-9519d1d7-61e8-4444-922a-97417f7d3576 req-e879986d-9d08-4455-b545-e86393aaec20 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:34.839141 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f3aea6e3-9954-4ee2-8a47-d5d90569f3e1 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1575 microversion: 2.1 time: 0.290247 Dec 14 10:14:34.839882 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 449/866] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:34 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1575 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:14:34.850131 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.compute.server_external_events [req-9519d1d7-61e8-4444-922a-97417f7d3576 req-e879986d-9d08-4455-b545-e86393aaec20 service nova] Unable to find a host for instance 457d8e04-7e43-4287-8640-efedad40515d. Dropping event network-vif-unplugged {{(pid=100985) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 14 10:14:34.851072 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-9519d1d7-61e8-4444-922a-97417f7d3576 req-e879986d-9d08-4455-b545-e86393aaec20 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032088 Dec 14 10:14:34.851728 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 418/867] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:14:34 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 14 10:14:35.072502 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-83ee6951-3a2e-487a-8ec5-e46e901263f8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:35.073502 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-83ee6951-3a2e-487a-8ec5-e46e901263f8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:35.080652 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-83ee6951-3a2e-487a-8ec5-e46e901263f8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:35.081097 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-83ee6951-3a2e-487a-8ec5-e46e901263f8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:35.081864 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-83ee6951-3a2e-487a-8ec5-e46e901263f8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:35.082398 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-83ee6951-3a2e-487a-8ec5-e46e901263f8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:35.197457 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-83ee6951-3a2e-487a-8ec5-e46e901263f8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 22664 microversion: 2.1 time: 0.128328 Dec 14 10:14:35.198319 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 450/868] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:35 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 22664 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:14:35.837199 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-82d79bf6-7312-4852-a1dc-14cf1e58c9ec tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:35.837888 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-82d79bf6-7312-4852-a1dc-14cf1e58c9ec tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:35.845409 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-82d79bf6-7312-4852-a1dc-14cf1e58c9ec tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:35.845861 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-82d79bf6-7312-4852-a1dc-14cf1e58c9ec tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:35.846666 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-82d79bf6-7312-4852-a1dc-14cf1e58c9ec tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:35.847102 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-82d79bf6-7312-4852-a1dc-14cf1e58c9ec tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:35.856749 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-9f36e2ce-063f-48e9-9e89-7a9c0474a0d8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:35.857550 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-9f36e2ce-063f-48e9-9e89-7a9c0474a0d8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:35.865258 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9f36e2ce-063f-48e9-9e89-7a9c0474a0d8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:35.865699 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9f36e2ce-063f-48e9-9e89-7a9c0474a0d8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:35.866490 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9f36e2ce-063f-48e9-9e89-7a9c0474a0d8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:35.867011 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9f36e2ce-063f-48e9-9e89-7a9c0474a0d8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:36.051122 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-82d79bf6-7312-4852-a1dc-14cf1e58c9ec tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:36.062052 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-82d79bf6-7312-4852-a1dc-14cf1e58c9ec tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:36.063866 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-82d79bf6-7312-4852-a1dc-14cf1e58c9ec tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:36.065298 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-82d79bf6-7312-4852-a1dc-14cf1e58c9ec tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1749 microversion: 2.20 time: 0.232488 Dec 14 10:14:36.069922 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 419/869] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:35 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1749 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:36.088650 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-9f36e2ce-063f-48e9-9e89-7a9c0474a0d8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:36.096950 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-9f36e2ce-063f-48e9-9e89-7a9c0474a0d8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1575 microversion: 2.1 time: 0.244219 Dec 14 10:14:36.097505 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 451/870] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:35 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1575 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:14:36.208571 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-aba3facb-c3bb-4d0d-b8ee-98e93db77396 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:36.209580 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-aba3facb-c3bb-4d0d-b8ee-98e93db77396 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:36.217081 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-aba3facb-c3bb-4d0d-b8ee-98e93db77396 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:36.217524 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-aba3facb-c3bb-4d0d-b8ee-98e93db77396 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:36.218318 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-aba3facb-c3bb-4d0d-b8ee-98e93db77396 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:36.218748 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-aba3facb-c3bb-4d0d-b8ee-98e93db77396 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:36.328027 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-aba3facb-c3bb-4d0d-b8ee-98e93db77396 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 23804 microversion: 2.1 time: 0.122861 Dec 14 10:14:36.331803 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 420/871] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:36 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 23804 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:14:37.088870 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c5d511cf-2168-4304-befa-698c1f3762f2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:37.089481 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c5d511cf-2168-4304-befa-698c1f3762f2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:37.097095 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c5d511cf-2168-4304-befa-698c1f3762f2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:37.097536 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c5d511cf-2168-4304-befa-698c1f3762f2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:37.098409 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c5d511cf-2168-4304-befa-698c1f3762f2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:37.099019 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c5d511cf-2168-4304-befa-698c1f3762f2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:37.115100 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-53489ebc-c8ca-4d53-9b52-f527c18a17e7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:37.115971 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-53489ebc-c8ca-4d53-9b52-f527c18a17e7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:37.124026 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-53489ebc-c8ca-4d53-9b52-f527c18a17e7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:37.124737 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-53489ebc-c8ca-4d53-9b52-f527c18a17e7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:37.125480 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-53489ebc-c8ca-4d53-9b52-f527c18a17e7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:37.126045 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-53489ebc-c8ca-4d53-9b52-f527c18a17e7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:37.310886 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c5d511cf-2168-4304-befa-698c1f3762f2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:37.319958 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c5d511cf-2168-4304-befa-698c1f3762f2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:37.322008 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c5d511cf-2168-4304-befa-698c1f3762f2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:37.323123 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c5d511cf-2168-4304-befa-698c1f3762f2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.238469 Dec 14 10:14:37.323710 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 452/872] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:37 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:37.338768 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-2890c5bc-54d7-4572-b6b5-85d8afb7a556 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:37.339720 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-2890c5bc-54d7-4572-b6b5-85d8afb7a556 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:37.347067 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2890c5bc-54d7-4572-b6b5-85d8afb7a556 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:37.347442 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2890c5bc-54d7-4572-b6b5-85d8afb7a556 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:37.348207 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2890c5bc-54d7-4572-b6b5-85d8afb7a556 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:37.348632 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2890c5bc-54d7-4572-b6b5-85d8afb7a556 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:37.453669 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-53489ebc-c8ca-4d53-9b52-f527c18a17e7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:37.459816 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-2890c5bc-54d7-4572-b6b5-85d8afb7a556 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 25469 microversion: 2.1 time: 0.124462 Dec 14 10:14:37.461527 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 453/873] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:37 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 25469 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:14:37.462238 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-53489ebc-c8ca-4d53-9b52-f527c18a17e7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1575 microversion: 2.1 time: 0.351378 Dec 14 10:14:37.462810 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 421/874] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:37 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1575 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:14:38.343311 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-0d469881-fc67-4ff6-9dbe-7e836ba65daa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:38.345489 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-0d469881-fc67-4ff6-9dbe-7e836ba65daa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:38.356327 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0d469881-fc67-4ff6-9dbe-7e836ba65daa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:38.357021 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0d469881-fc67-4ff6-9dbe-7e836ba65daa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:38.358055 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0d469881-fc67-4ff6-9dbe-7e836ba65daa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:38.358679 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0d469881-fc67-4ff6-9dbe-7e836ba65daa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:38.472417 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f0c5c4d7-fb2c-46d4-b334-bbee5f23abd8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:38.474385 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f0c5c4d7-fb2c-46d4-b334-bbee5f23abd8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:38.483098 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f0c5c4d7-fb2c-46d4-b334-bbee5f23abd8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:38.483895 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f0c5c4d7-fb2c-46d4-b334-bbee5f23abd8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:38.484903 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f0c5c4d7-fb2c-46d4-b334-bbee5f23abd8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:38.485574 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f0c5c4d7-fb2c-46d4-b334-bbee5f23abd8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:38.571443 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-0d469881-fc67-4ff6-9dbe-7e836ba65daa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:38.580883 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-0d469881-fc67-4ff6-9dbe-7e836ba65daa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:38.582414 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-0d469881-fc67-4ff6-9dbe-7e836ba65daa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:38.583543 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-0d469881-fc67-4ff6-9dbe-7e836ba65daa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.246186 Dec 14 10:14:38.584277 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 454/875] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:38 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:38.589287 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-36262ff5-a8e2-4bfc-936d-8c7075e8dae7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:38.589873 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-36262ff5-a8e2-4bfc-936d-8c7075e8dae7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:38.597250 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-36262ff5-a8e2-4bfc-936d-8c7075e8dae7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:38.597629 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-36262ff5-a8e2-4bfc-936d-8c7075e8dae7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:38.598502 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-36262ff5-a8e2-4bfc-936d-8c7075e8dae7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:38.598946 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-36262ff5-a8e2-4bfc-936d-8c7075e8dae7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:38.819346 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-36262ff5-a8e2-4bfc-936d-8c7075e8dae7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:38.829093 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-36262ff5-a8e2-4bfc-936d-8c7075e8dae7 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1575 microversion: 2.1 time: 0.243800 Dec 14 10:14:38.829886 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 455/876] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:38 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1575 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:39.603750 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e4ad4158-6543-4e42-ba3d-a454d228a737 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:39.604426 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e4ad4158-6543-4e42-ba3d-a454d228a737 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:39.612096 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e4ad4158-6543-4e42-ba3d-a454d228a737 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:39.612547 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e4ad4158-6543-4e42-ba3d-a454d228a737 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:39.613313 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e4ad4158-6543-4e42-ba3d-a454d228a737 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:39.613738 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e4ad4158-6543-4e42-ba3d-a454d228a737 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:39.825477 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e4ad4158-6543-4e42-ba3d-a454d228a737 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:39.835893 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e4ad4158-6543-4e42-ba3d-a454d228a737 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:39.838711 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e4ad4158-6543-4e42-ba3d-a454d228a737 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:39.840001 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e4ad4158-6543-4e42-ba3d-a454d228a737 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.240785 Dec 14 10:14:39.840816 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 456/877] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:39 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:14:39.859081 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8d51b854-769b-46ad-9e0d-5b10b3a79231 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:39.859587 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-8d51b854-769b-46ad-9e0d-5b10b3a79231 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:39.866993 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8d51b854-769b-46ad-9e0d-5b10b3a79231 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:39.867492 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8d51b854-769b-46ad-9e0d-5b10b3a79231 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:39.868269 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8d51b854-769b-46ad-9e0d-5b10b3a79231 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:39.868702 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8d51b854-769b-46ad-9e0d-5b10b3a79231 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:40.073838 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-8d51b854-769b-46ad-9e0d-5b10b3a79231 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:40.082275 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8d51b854-769b-46ad-9e0d-5b10b3a79231 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1575 microversion: 2.1 time: 0.226804 Dec 14 10:14:40.082840 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 457/878] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:39 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:14:40.860224 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-aba54893-f218-4e1d-ba4f-979120f4a05d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:40.860850 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-aba54893-f218-4e1d-ba4f-979120f4a05d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:40.868516 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aba54893-f218-4e1d-ba4f-979120f4a05d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:40.868967 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aba54893-f218-4e1d-ba4f-979120f4a05d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:40.869738 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aba54893-f218-4e1d-ba4f-979120f4a05d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:40.870211 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aba54893-f218-4e1d-ba4f-979120f4a05d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:41.076346 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-aba54893-f218-4e1d-ba4f-979120f4a05d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:41.085209 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-aba54893-f218-4e1d-ba4f-979120f4a05d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:41.087327 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-aba54893-f218-4e1d-ba4f-979120f4a05d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:41.088458 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-aba54893-f218-4e1d-ba4f-979120f4a05d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.232212 Dec 14 10:14:41.089010 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 458/879] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:40 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:14:41.099102 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-96291d20-d989-40f4-9e5a-2ed803a5ed80 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:41.099691 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-96291d20-d989-40f4-9e5a-2ed803a5ed80 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:41.107326 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-96291d20-d989-40f4-9e5a-2ed803a5ed80 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:41.107766 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-96291d20-d989-40f4-9e5a-2ed803a5ed80 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:41.108523 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-96291d20-d989-40f4-9e5a-2ed803a5ed80 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:41.108950 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-96291d20-d989-40f4-9e5a-2ed803a5ed80 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:41.312373 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-96291d20-d989-40f4-9e5a-2ed803a5ed80 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:41.320311 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-96291d20-d989-40f4-9e5a-2ed803a5ed80 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1575 microversion: 2.1 time: 0.224426 Dec 14 10:14:41.321446 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 459/880] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:41 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:14:42.107631 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e11f02c7-3038-4712-bc06-a5335f6788eb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:42.108308 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e11f02c7-3038-4712-bc06-a5335f6788eb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:42.115813 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e11f02c7-3038-4712-bc06-a5335f6788eb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:42.116253 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e11f02c7-3038-4712-bc06-a5335f6788eb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:42.117011 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e11f02c7-3038-4712-bc06-a5335f6788eb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:42.117510 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e11f02c7-3038-4712-bc06-a5335f6788eb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:42.412292 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e11f02c7-3038-4712-bc06-a5335f6788eb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:42.422502 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e11f02c7-3038-4712-bc06-a5335f6788eb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:42.424042 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e11f02c7-3038-4712-bc06-a5335f6788eb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:42.425169 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e11f02c7-3038-4712-bc06-a5335f6788eb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.321407 Dec 14 10:14:42.428619 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 460/881] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:42 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:14:42.431461 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-73bf2aa6-ad02-4a42-aa79-11dcd5faf81a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:42.432065 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-73bf2aa6-ad02-4a42-aa79-11dcd5faf81a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:42.439203 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73bf2aa6-ad02-4a42-aa79-11dcd5faf81a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:42.439637 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73bf2aa6-ad02-4a42-aa79-11dcd5faf81a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:42.440391 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73bf2aa6-ad02-4a42-aa79-11dcd5faf81a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:42.440810 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73bf2aa6-ad02-4a42-aa79-11dcd5faf81a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:42.646113 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-73bf2aa6-ad02-4a42-aa79-11dcd5faf81a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:42.655377 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-73bf2aa6-ad02-4a42-aa79-11dcd5faf81a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1575 microversion: 2.1 time: 0.228168 Dec 14 10:14:42.655979 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 461/882] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:42 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:43.444439 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-7e9af015-b005-46ca-917f-04aedfcdf3e3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:43.445108 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-7e9af015-b005-46ca-917f-04aedfcdf3e3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:43.453374 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7e9af015-b005-46ca-917f-04aedfcdf3e3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:43.453856 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7e9af015-b005-46ca-917f-04aedfcdf3e3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:43.454672 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7e9af015-b005-46ca-917f-04aedfcdf3e3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:43.455106 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7e9af015-b005-46ca-917f-04aedfcdf3e3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:43.659666 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-7e9af015-b005-46ca-917f-04aedfcdf3e3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:43.668817 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-7e9af015-b005-46ca-917f-04aedfcdf3e3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:43.670341 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-7e9af015-b005-46ca-917f-04aedfcdf3e3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:43.671460 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-7e9af015-b005-46ca-917f-04aedfcdf3e3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.230788 Dec 14 10:14:43.672198 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 462/883] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:43 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:14:43.677152 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-95956694-5925-4e3a-b1ef-80d008dff4d2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:43.677881 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-95956694-5925-4e3a-b1ef-80d008dff4d2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:43.686080 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-95956694-5925-4e3a-b1ef-80d008dff4d2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:43.686521 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-95956694-5925-4e3a-b1ef-80d008dff4d2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:43.687280 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-95956694-5925-4e3a-b1ef-80d008dff4d2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:43.687732 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-95956694-5925-4e3a-b1ef-80d008dff4d2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:43.893908 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-95956694-5925-4e3a-b1ef-80d008dff4d2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:43.902985 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-95956694-5925-4e3a-b1ef-80d008dff4d2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1575 microversion: 2.1 time: 0.229063 Dec 14 10:14:43.903824 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 463/884] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:43 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1575 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:44.690038 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4781d542-ae3d-4f05-a09d-5baf5502d916 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:44.690716 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4781d542-ae3d-4f05-a09d-5baf5502d916 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:44.698984 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4781d542-ae3d-4f05-a09d-5baf5502d916 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:44.699442 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4781d542-ae3d-4f05-a09d-5baf5502d916 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:44.700213 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4781d542-ae3d-4f05-a09d-5baf5502d916 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:44.700644 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4781d542-ae3d-4f05-a09d-5baf5502d916 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:44.907222 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4781d542-ae3d-4f05-a09d-5baf5502d916 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:44.918650 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4781d542-ae3d-4f05-a09d-5baf5502d916 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:44.920149 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4781d542-ae3d-4f05-a09d-5baf5502d916 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:44.921453 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4781d542-ae3d-4f05-a09d-5baf5502d916 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.235003 Dec 14 10:14:44.932338 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 464/885] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:44 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:14:44.932338 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-705ea413-f7a0-4aa5-86e4-ac78fb38d29c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:44.932338 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-705ea413-f7a0-4aa5-86e4-ac78fb38d29c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:44.935083 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-705ea413-f7a0-4aa5-86e4-ac78fb38d29c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:44.935527 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-705ea413-f7a0-4aa5-86e4-ac78fb38d29c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:44.936301 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-705ea413-f7a0-4aa5-86e4-ac78fb38d29c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:44.936733 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-705ea413-f7a0-4aa5-86e4-ac78fb38d29c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:45.177750 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-705ea413-f7a0-4aa5-86e4-ac78fb38d29c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:45.186494 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-705ea413-f7a0-4aa5-86e4-ac78fb38d29c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1575 microversion: 2.1 time: 0.263108 Dec 14 10:14:45.187064 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 465/886] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:44 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1575 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:45.939783 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-74f00b51-c5b8-4f58-b5e0-0e5f83bf6f39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:45.940493 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-74f00b51-c5b8-4f58-b5e0-0e5f83bf6f39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:45.949096 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-74f00b51-c5b8-4f58-b5e0-0e5f83bf6f39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:45.949549 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-74f00b51-c5b8-4f58-b5e0-0e5f83bf6f39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:45.950369 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-74f00b51-c5b8-4f58-b5e0-0e5f83bf6f39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:45.950785 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-74f00b51-c5b8-4f58-b5e0-0e5f83bf6f39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:46.159694 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-74f00b51-c5b8-4f58-b5e0-0e5f83bf6f39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:46.169209 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-74f00b51-c5b8-4f58-b5e0-0e5f83bf6f39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:46.170732 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-74f00b51-c5b8-4f58-b5e0-0e5f83bf6f39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:46.171843 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-74f00b51-c5b8-4f58-b5e0-0e5f83bf6f39 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.235765 Dec 14 10:14:46.172387 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 466/887] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:45 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:14:46.203957 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d14eca9d-39ff-4c74-973d-6867aef37ee8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:46.204461 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d14eca9d-39ff-4c74-973d-6867aef37ee8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:46.212553 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d14eca9d-39ff-4c74-973d-6867aef37ee8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:46.212990 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d14eca9d-39ff-4c74-973d-6867aef37ee8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:46.213803 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d14eca9d-39ff-4c74-973d-6867aef37ee8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:46.214201 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d14eca9d-39ff-4c74-973d-6867aef37ee8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:46.418570 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d14eca9d-39ff-4c74-973d-6867aef37ee8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:46.426885 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d14eca9d-39ff-4c74-973d-6867aef37ee8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1575 microversion: 2.1 time: 0.226588 Dec 14 10:14:46.427444 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 467/888] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:46 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:14:47.190652 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-9b80db67-6e1c-4cbd-bf41-866c3a0ec854 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:47.191312 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-9b80db67-6e1c-4cbd-bf41-866c3a0ec854 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:47.198636 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9b80db67-6e1c-4cbd-bf41-866c3a0ec854 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:47.198889 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9b80db67-6e1c-4cbd-bf41-866c3a0ec854 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:47.199648 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9b80db67-6e1c-4cbd-bf41-866c3a0ec854 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:47.200079 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9b80db67-6e1c-4cbd-bf41-866c3a0ec854 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:47.411381 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-9b80db67-6e1c-4cbd-bf41-866c3a0ec854 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:47.421289 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-9b80db67-6e1c-4cbd-bf41-866c3a0ec854 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:47.422909 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-9b80db67-6e1c-4cbd-bf41-866c3a0ec854 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:47.423981 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-9b80db67-6e1c-4cbd-bf41-866c3a0ec854 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.237013 Dec 14 10:14:47.435785 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 468/889] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:47 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:14:47.444375 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c3c864fb-bce4-4109-8e49-4ac64426cd15 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:47.444907 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c3c864fb-bce4-4109-8e49-4ac64426cd15 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:47.452881 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c3c864fb-bce4-4109-8e49-4ac64426cd15 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:47.453327 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c3c864fb-bce4-4109-8e49-4ac64426cd15 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:47.454145 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c3c864fb-bce4-4109-8e49-4ac64426cd15 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:47.454580 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c3c864fb-bce4-4109-8e49-4ac64426cd15 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:47.663003 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c3c864fb-bce4-4109-8e49-4ac64426cd15 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:47.671665 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c3c864fb-bce4-4109-8e49-4ac64426cd15 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1575 microversion: 2.1 time: 0.230983 Dec 14 10:14:47.672233 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 469/890] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:47 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1575 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:14:48.443375 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-b56f9adc-46ff-4ef8-94f5-ffdd9340a8cc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:48.444044 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-b56f9adc-46ff-4ef8-94f5-ffdd9340a8cc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:48.451295 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b56f9adc-46ff-4ef8-94f5-ffdd9340a8cc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:48.451739 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b56f9adc-46ff-4ef8-94f5-ffdd9340a8cc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:48.452496 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b56f9adc-46ff-4ef8-94f5-ffdd9340a8cc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:48.452928 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b56f9adc-46ff-4ef8-94f5-ffdd9340a8cc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:48.675810 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-b56f9adc-46ff-4ef8-94f5-ffdd9340a8cc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:48.684773 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-b56f9adc-46ff-4ef8-94f5-ffdd9340a8cc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:48.686271 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-b56f9adc-46ff-4ef8-94f5-ffdd9340a8cc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:48.687390 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-b56f9adc-46ff-4ef8-94f5-ffdd9340a8cc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.247836 Dec 14 10:14:48.687936 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 470/891] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:48 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:14:48.691983 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-ec616b5d-62fa-45ea-b08d-9e337ddb6d1c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:48.692578 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-ec616b5d-62fa-45ea-b08d-9e337ddb6d1c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:48.699906 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ec616b5d-62fa-45ea-b08d-9e337ddb6d1c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:48.700279 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ec616b5d-62fa-45ea-b08d-9e337ddb6d1c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:48.701026 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ec616b5d-62fa-45ea-b08d-9e337ddb6d1c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:48.701448 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ec616b5d-62fa-45ea-b08d-9e337ddb6d1c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:48.903719 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-ec616b5d-62fa-45ea-b08d-9e337ddb6d1c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:48.911937 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-ec616b5d-62fa-45ea-b08d-9e337ddb6d1c tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1575 microversion: 2.1 time: 0.223084 Dec 14 10:14:48.912505 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 471/892] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:48 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1575 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:49.705901 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4942062d-b3be-4175-b41c-3a90068cd81e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:49.706574 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4942062d-b3be-4175-b41c-3a90068cd81e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:49.714287 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4942062d-b3be-4175-b41c-3a90068cd81e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:49.714733 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4942062d-b3be-4175-b41c-3a90068cd81e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:49.715486 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4942062d-b3be-4175-b41c-3a90068cd81e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:49.715912 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4942062d-b3be-4175-b41c-3a90068cd81e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:49.922777 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4942062d-b3be-4175-b41c-3a90068cd81e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:49.932748 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4942062d-b3be-4175-b41c-3a90068cd81e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:49.934338 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4942062d-b3be-4175-b41c-3a90068cd81e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:49.935468 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4942062d-b3be-4175-b41c-3a90068cd81e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.233287 Dec 14 10:14:49.936007 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 472/893] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:49 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:14:49.940104 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-39e45ea5-b295-458e-920a-49ad57f2d046 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:49.940699 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-39e45ea5-b295-458e-920a-49ad57f2d046 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:49.948258 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-39e45ea5-b295-458e-920a-49ad57f2d046 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:49.948700 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-39e45ea5-b295-458e-920a-49ad57f2d046 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:49.949459 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-39e45ea5-b295-458e-920a-49ad57f2d046 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:49.949919 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-39e45ea5-b295-458e-920a-49ad57f2d046 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:50.144036 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-39e45ea5-b295-458e-920a-49ad57f2d046 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:50.152518 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-39e45ea5-b295-458e-920a-49ad57f2d046 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1575 microversion: 2.1 time: 0.215588 Dec 14 10:14:50.153082 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 473/894] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:49 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1575 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:14:50.537470 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f0c5c4d7-fb2c-46d4-b334-bbee5f23abd8 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 30891 microversion: 2.1 time: 12.068990 Dec 14 10:14:50.538637 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 422/895] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:38 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 30891 bytes in 12071 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:14:50.953985 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5943ac23-59d4-4e87-8a7d-d45f30c67242 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:50.954600 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5943ac23-59d4-4e87-8a7d-d45f30c67242 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:50.963914 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5943ac23-59d4-4e87-8a7d-d45f30c67242 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:50.964600 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5943ac23-59d4-4e87-8a7d-d45f30c67242 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:50.965380 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5943ac23-59d4-4e87-8a7d-d45f30c67242 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:50.965814 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5943ac23-59d4-4e87-8a7d-d45f30c67242 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:51.163846 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5943ac23-59d4-4e87-8a7d-d45f30c67242 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:51.169872 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-720a51a2-0eb1-4429-9642-18ce40664b1b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:51.170603 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-720a51a2-0eb1-4429-9642-18ce40664b1b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:51.173695 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5943ac23-59d4-4e87-8a7d-d45f30c67242 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:51.175270 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5943ac23-59d4-4e87-8a7d-d45f30c67242 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:51.176464 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5943ac23-59d4-4e87-8a7d-d45f30c67242 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.226216 Dec 14 10:14:51.177146 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 474/896] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:50 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:51.178204 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-720a51a2-0eb1-4429-9642-18ce40664b1b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:51.178648 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-720a51a2-0eb1-4429-9642-18ce40664b1b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:51.179404 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-720a51a2-0eb1-4429-9642-18ce40664b1b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:51.180867 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-720a51a2-0eb1-4429-9642-18ce40664b1b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:51.381395 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-720a51a2-0eb1-4429-9642-18ce40664b1b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:51.389608 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-720a51a2-0eb1-4429-9642-18ce40664b1b tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1575 microversion: 2.1 time: 0.224223 Dec 14 10:14:51.390195 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 423/897] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:51 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:14:51.549733 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-451d4b79-bbd0-4001-b36d-8848ff27cee6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:51.550670 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-451d4b79-bbd0-4001-b36d-8848ff27cee6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:51.558574 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-451d4b79-bbd0-4001-b36d-8848ff27cee6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:51.559017 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-451d4b79-bbd0-4001-b36d-8848ff27cee6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:51.559775 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-451d4b79-bbd0-4001-b36d-8848ff27cee6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:51.560228 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-451d4b79-bbd0-4001-b36d-8848ff27cee6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:51.679006 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-451d4b79-bbd0-4001-b36d-8848ff27cee6 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 32580 microversion: 2.1 time: 0.132760 Dec 14 10:14:51.679644 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 475/898] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:51 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 32580 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:14:52.195259 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f8b1249f-2ad3-4b84-ba19-a2fc7954a044 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:52.195932 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f8b1249f-2ad3-4b84-ba19-a2fc7954a044 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:52.203466 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f8b1249f-2ad3-4b84-ba19-a2fc7954a044 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:52.203902 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f8b1249f-2ad3-4b84-ba19-a2fc7954a044 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:52.204663 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f8b1249f-2ad3-4b84-ba19-a2fc7954a044 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:52.205091 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f8b1249f-2ad3-4b84-ba19-a2fc7954a044 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:52.402442 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f8b1249f-2ad3-4b84-ba19-a2fc7954a044 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:52.407790 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1964ae22-6f09-4de0-b75b-be55674d45c2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:52.408606 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1964ae22-6f09-4de0-b75b-be55674d45c2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:52.411441 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f8b1249f-2ad3-4b84-ba19-a2fc7954a044 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:52.412926 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f8b1249f-2ad3-4b84-ba19-a2fc7954a044 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:52.414878 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f8b1249f-2ad3-4b84-ba19-a2fc7954a044 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.222541 Dec 14 10:14:52.415438 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 424/899] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:52 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:52.417105 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1964ae22-6f09-4de0-b75b-be55674d45c2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:52.417551 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1964ae22-6f09-4de0-b75b-be55674d45c2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:52.418341 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1964ae22-6f09-4de0-b75b-be55674d45c2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:52.418772 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1964ae22-6f09-4de0-b75b-be55674d45c2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:52.618095 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1964ae22-6f09-4de0-b75b-be55674d45c2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:52.626244 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1964ae22-6f09-4de0-b75b-be55674d45c2 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1562 microversion: 2.1 time: 0.222442 Dec 14 10:14:52.626804 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 476/900] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:14:52 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1562 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:14:52.689902 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c07c8296-3499-4185-80d0-3cda92f837a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:52.690832 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c07c8296-3499-4185-80d0-3cda92f837a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:52.698265 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c07c8296-3499-4185-80d0-3cda92f837a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:52.698715 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c07c8296-3499-4185-80d0-3cda92f837a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:52.699517 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c07c8296-3499-4185-80d0-3cda92f837a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:52.700102 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c07c8296-3499-4185-80d0-3cda92f837a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:52.815335 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c07c8296-3499-4185-80d0-3cda92f837a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 33682 microversion: 2.1 time: 0.128795 Dec 14 10:14:52.816564 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 425/901] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:52 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 33682 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:14:53.433612 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4586047b-ed06-44b1-9eb4-d14276be84d8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:53.434294 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4586047b-ed06-44b1-9eb4-d14276be84d8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:53.441817 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4586047b-ed06-44b1-9eb4-d14276be84d8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:53.442296 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4586047b-ed06-44b1-9eb4-d14276be84d8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:53.443059 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4586047b-ed06-44b1-9eb4-d14276be84d8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:53.443485 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4586047b-ed06-44b1-9eb4-d14276be84d8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:53.636000 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4586047b-ed06-44b1-9eb4-d14276be84d8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:53.644970 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4586047b-ed06-44b1-9eb4-d14276be84d8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:53.646484 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4586047b-ed06-44b1-9eb4-d14276be84d8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:53.647588 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4586047b-ed06-44b1-9eb4-d14276be84d8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.218449 Dec 14 10:14:53.648135 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 477/902] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:53 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:53.827616 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e255f100-e682-4909-8eb9-ff10af4c2a88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:53.828573 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e255f100-e682-4909-8eb9-ff10af4c2a88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:53.836325 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e255f100-e682-4909-8eb9-ff10af4c2a88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:53.836770 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e255f100-e682-4909-8eb9-ff10af4c2a88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:53.837532 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e255f100-e682-4909-8eb9-ff10af4c2a88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:53.837983 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e255f100-e682-4909-8eb9-ff10af4c2a88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:53.955612 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e255f100-e682-4909-8eb9-ff10af4c2a88 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 34548 microversion: 2.1 time: 0.131930 Dec 14 10:14:53.956224 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 426/903] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:53 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 34548 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:14:54.666065 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1016fa8d-4ead-463f-a567-ecc493902421 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:54.666702 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1016fa8d-4ead-463f-a567-ecc493902421 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:54.674090 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1016fa8d-4ead-463f-a567-ecc493902421 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:54.674539 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1016fa8d-4ead-463f-a567-ecc493902421 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:54.675310 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1016fa8d-4ead-463f-a567-ecc493902421 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:54.675744 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1016fa8d-4ead-463f-a567-ecc493902421 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:54.819380 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-48cf023c-a848-474b-ac7e-b9ee646caecb req-022ea224-46e4-4893-8609-9439ad6bbdec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731c99da-4633-4de9-9678-02e9fecda7b4", "name": "network-vif-plugged", "status": "completed", "tag": "eb309f74-48d9-4eb5-98e8-7571414fa330"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:54.821632 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:14:54.821632 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:14:54.830675 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-48cf023c-a848-474b-ac7e-b9ee646caecb req-022ea224-46e4-4893-8609-9439ad6bbdec service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:54.831307 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-48cf023c-a848-474b-ac7e-b9ee646caecb req-022ea224-46e4-4893-8609-9439ad6bbdec service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:54.847382 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-48cf023c-a848-474b-ac7e-b9ee646caecb req-022ea224-46e4-4893-8609-9439ad6bbdec service nova] Creating event network-vif-plugged:eb309f74-48d9-4eb5-98e8-7571414fa330 for instance 731c99da-4633-4de9-9678-02e9fecda7b4 on hv-cinder-81888 Dec 14 10:14:54.852026 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-48cf023c-a848-474b-ac7e-b9ee646caecb req-022ea224-46e4-4893-8609-9439ad6bbdec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038107 Dec 14 10:14:54.853041 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 427/904] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:14:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:14:54.882093 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1016fa8d-4ead-463f-a567-ecc493902421 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:54.891822 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1016fa8d-4ead-463f-a567-ecc493902421 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:54.893304 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1016fa8d-4ead-463f-a567-ecc493902421 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:54.894457 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1016fa8d-4ead-463f-a567-ecc493902421 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.232347 Dec 14 10:14:54.895013 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 478/905] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:54 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:54.968126 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a29d623f-1a98-4afa-8c2f-adc9f03edb9f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:54.969124 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a29d623f-1a98-4afa-8c2f-adc9f03edb9f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:54.976500 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a29d623f-1a98-4afa-8c2f-adc9f03edb9f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:54.976978 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a29d623f-1a98-4afa-8c2f-adc9f03edb9f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:54.977977 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a29d623f-1a98-4afa-8c2f-adc9f03edb9f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:54.978417 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a29d623f-1a98-4afa-8c2f-adc9f03edb9f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:55.083637 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a29d623f-1a98-4afa-8c2f-adc9f03edb9f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 35578 microversion: 2.1 time: 0.119606 Dec 14 10:14:55.084279 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 428/906] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:54 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 35578 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:14:55.913053 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d86a5713-ed4b-4431-83be-932970ab0c8f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:55.913657 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d86a5713-ed4b-4431-83be-932970ab0c8f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:55.921720 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d86a5713-ed4b-4431-83be-932970ab0c8f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:55.922195 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d86a5713-ed4b-4431-83be-932970ab0c8f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:55.922947 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d86a5713-ed4b-4431-83be-932970ab0c8f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:55.923373 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d86a5713-ed4b-4431-83be-932970ab0c8f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:56.096022 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-2d66d7df-d95f-45bc-93a5-2f772d5d36f9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:56.097040 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-2d66d7df-d95f-45bc-93a5-2f772d5d36f9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:56.105449 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2d66d7df-d95f-45bc-93a5-2f772d5d36f9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:56.105893 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2d66d7df-d95f-45bc-93a5-2f772d5d36f9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:56.106712 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2d66d7df-d95f-45bc-93a5-2f772d5d36f9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:56.107144 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2d66d7df-d95f-45bc-93a5-2f772d5d36f9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:56.123900 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d86a5713-ed4b-4431-83be-932970ab0c8f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:56.132940 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d86a5713-ed4b-4431-83be-932970ab0c8f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:56.134459 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d86a5713-ed4b-4431-83be-932970ab0c8f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:56.135568 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d86a5713-ed4b-4431-83be-932970ab0c8f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.226186 Dec 14 10:14:56.136119 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 479/907] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:55 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:56.214599 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-2d66d7df-d95f-45bc-93a5-2f772d5d36f9 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 37016 microversion: 2.1 time: 0.122392 Dec 14 10:14:56.215200 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 429/908] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:56 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 37016 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:14:57.153772 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-49479834-8019-463c-a5f5-6afb4a9f4f85 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:57.154397 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-49479834-8019-463c-a5f5-6afb4a9f4f85 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:57.161595 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49479834-8019-463c-a5f5-6afb4a9f4f85 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:57.162063 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49479834-8019-463c-a5f5-6afb4a9f4f85 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:57.162814 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49479834-8019-463c-a5f5-6afb4a9f4f85 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:57.163239 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49479834-8019-463c-a5f5-6afb4a9f4f85 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:57.227126 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-8de15e1a-9a3d-4c30-bac5-3bed4b6d61dc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:57.228333 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-8de15e1a-9a3d-4c30-bac5-3bed4b6d61dc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:57.236227 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8de15e1a-9a3d-4c30-bac5-3bed4b6d61dc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:57.236675 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8de15e1a-9a3d-4c30-bac5-3bed4b6d61dc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:57.237447 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8de15e1a-9a3d-4c30-bac5-3bed4b6d61dc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:57.237881 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8de15e1a-9a3d-4c30-bac5-3bed4b6d61dc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:57.361278 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-8de15e1a-9a3d-4c30-bac5-3bed4b6d61dc tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 38174 microversion: 2.1 time: 0.138021 Dec 14 10:14:57.361938 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 430/909] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:57 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 38174 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 14 10:14:57.370722 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-49479834-8019-463c-a5f5-6afb4a9f4f85 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:57.379627 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-49479834-8019-463c-a5f5-6afb4a9f4f85 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:57.381103 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-49479834-8019-463c-a5f5-6afb4a9f4f85 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:57.382234 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-49479834-8019-463c-a5f5-6afb4a9f4f85 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.232438 Dec 14 10:14:57.382774 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 480/910] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:57 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:14:58.373837 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-dc9f0ce2-27af-465b-a132-5ed72ed70d58 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:58.374791 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-dc9f0ce2-27af-465b-a132-5ed72ed70d58 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:58.382597 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dc9f0ce2-27af-465b-a132-5ed72ed70d58 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:58.383540 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dc9f0ce2-27af-465b-a132-5ed72ed70d58 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:58.384319 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dc9f0ce2-27af-465b-a132-5ed72ed70d58 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:58.384762 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-dc9f0ce2-27af-465b-a132-5ed72ed70d58 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:58.399956 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-007f752e-e596-4e06-ad94-98fdcd10858a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:58.401408 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-007f752e-e596-4e06-ad94-98fdcd10858a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:58.408605 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-007f752e-e596-4e06-ad94-98fdcd10858a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:58.409041 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-007f752e-e596-4e06-ad94-98fdcd10858a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:58.409793 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-007f752e-e596-4e06-ad94-98fdcd10858a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:58.410259 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-007f752e-e596-4e06-ad94-98fdcd10858a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:58.482927 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-dc9f0ce2-27af-465b-a132-5ed72ed70d58 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 38174 microversion: 2.1 time: 0.113035 Dec 14 10:14:58.483593 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 431/911] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:58 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 38174 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:14:58.696682 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-007f752e-e596-4e06-ad94-98fdcd10858a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:58.705863 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-007f752e-e596-4e06-ad94-98fdcd10858a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:58.707445 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-007f752e-e596-4e06-ad94-98fdcd10858a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:58.708647 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-007f752e-e596-4e06-ad94-98fdcd10858a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.312432 Dec 14 10:14:58.709312 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 481/912] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:58 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:14:59.495532 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-9689b3c3-77d8-480c-a7d2-0b84298d367b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:14:59.496531 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-9689b3c3-77d8-480c-a7d2-0b84298d367b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:59.504261 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9689b3c3-77d8-480c-a7d2-0b84298d367b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:59.504705 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9689b3c3-77d8-480c-a7d2-0b84298d367b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:59.505465 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9689b3c3-77d8-480c-a7d2-0b84298d367b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:59.505893 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9689b3c3-77d8-480c-a7d2-0b84298d367b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:59.600771 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-9689b3c3-77d8-480c-a7d2-0b84298d367b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 38174 microversion: 2.1 time: 0.109244 Dec 14 10:14:59.601382 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 432/913] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:14:59 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 38174 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:14:59.726983 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5045986c-a09f-43b0-83d4-683df37d662a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:14:59.727653 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5045986c-a09f-43b0-83d4-683df37d662a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:14:59.735072 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5045986c-a09f-43b0-83d4-683df37d662a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:59.735524 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5045986c-a09f-43b0-83d4-683df37d662a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:59.736281 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5045986c-a09f-43b0-83d4-683df37d662a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:14:59.736713 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5045986c-a09f-43b0-83d4-683df37d662a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:14:59.930568 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5045986c-a09f-43b0-83d4-683df37d662a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:59.939545 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5045986c-a09f-43b0-83d4-683df37d662a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:59.941040 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5045986c-a09f-43b0-83d4-683df37d662a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:14:59.942191 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5045986c-a09f-43b0-83d4-683df37d662a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.218902 Dec 14 10:14:59.942748 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 482/914] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:14:59 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:15:00.613840 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-74580576-919b-4560-ba59-8d8b525ff625 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:15:00.614868 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-74580576-919b-4560-ba59-8d8b525ff625 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:00.623398 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-74580576-919b-4560-ba59-8d8b525ff625 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:00.623852 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-74580576-919b-4560-ba59-8d8b525ff625 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:00.624647 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-74580576-919b-4560-ba59-8d8b525ff625 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:00.625074 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-74580576-919b-4560-ba59-8d8b525ff625 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:00.728038 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-74580576-919b-4560-ba59-8d8b525ff625 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 38174 microversion: 2.1 time: 0.117484 Dec 14 10:15:00.732153 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 433/915] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:15:00 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 38174 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:15:00.836040 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-8c88779d-e51f-47a0-9645-3862fe47ff39 req-de3c920b-bda1-4d89-94fa-cc2ac512abfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "457d8e04-7e43-4287-8640-efedad40515d", "name": "network-vif-plugged", "status": "completed", "tag": "07c89ab1-3f66-4963-95e3-1048fc17638b"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:15:00.838694 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:15:00.838694 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:15:00.848100 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-8c88779d-e51f-47a0-9645-3862fe47ff39 req-de3c920b-bda1-4d89-94fa-cc2ac512abfd service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:00.848538 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-8c88779d-e51f-47a0-9645-3862fe47ff39 req-de3c920b-bda1-4d89-94fa-cc2ac512abfd service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:00.864693 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-8c88779d-e51f-47a0-9645-3862fe47ff39 req-de3c920b-bda1-4d89-94fa-cc2ac512abfd service nova] Creating event network-vif-plugged:07c89ab1-3f66-4963-95e3-1048fc17638b for instance 457d8e04-7e43-4287-8640-efedad40515d on hv-cinder-81888 Dec 14 10:15:00.869586 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-8c88779d-e51f-47a0-9645-3862fe47ff39 req-de3c920b-bda1-4d89-94fa-cc2ac512abfd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037226 Dec 14 10:15:00.870448 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 483/916] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:15:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:15:00.961777 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-1c28c134-1260-49b9-b185-0418a9ffd538 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:00.962527 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-1c28c134-1260-49b9-b185-0418a9ffd538 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:00.970309 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1c28c134-1260-49b9-b185-0418a9ffd538 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:00.970748 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1c28c134-1260-49b9-b185-0418a9ffd538 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:00.971510 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1c28c134-1260-49b9-b185-0418a9ffd538 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:00.971938 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1c28c134-1260-49b9-b185-0418a9ffd538 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:01.367112 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-1c28c134-1260-49b9-b185-0418a9ffd538 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:01.376875 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-1c28c134-1260-49b9-b185-0418a9ffd538 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:01.378388 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-1c28c134-1260-49b9-b185-0418a9ffd538 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:01.379513 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-1c28c134-1260-49b9-b185-0418a9ffd538 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.422368 Dec 14 10:15:01.380060 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 434/917] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:15:00 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:15:01.739366 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d8cc2eef-5aaf-44f7-b075-70bdf6545947 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:15:01.740351 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d8cc2eef-5aaf-44f7-b075-70bdf6545947 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:01.747756 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d8cc2eef-5aaf-44f7-b075-70bdf6545947 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:01.748195 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d8cc2eef-5aaf-44f7-b075-70bdf6545947 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:01.748953 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d8cc2eef-5aaf-44f7-b075-70bdf6545947 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:01.749381 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d8cc2eef-5aaf-44f7-b075-70bdf6545947 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:01.852688 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d8cc2eef-5aaf-44f7-b075-70bdf6545947 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action" status: 200 len: 38305 microversion: 2.1 time: 0.116609 Dec 14 10:15:01.853366 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 484/918] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Dec 14 10:15:01 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/action => generated 38305 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:15:01.862862 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-2a258cb7-926a-4a6b-aec3-64f56530291c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:01.863355 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-2a258cb7-926a-4a6b-aec3-64f56530291c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:01.870557 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2a258cb7-926a-4a6b-aec3-64f56530291c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:01.870999 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2a258cb7-926a-4a6b-aec3-64f56530291c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:01.871759 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2a258cb7-926a-4a6b-aec3-64f56530291c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:01.872188 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2a258cb7-926a-4a6b-aec3-64f56530291c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:01.927843 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-2a258cb7-926a-4a6b-aec3-64f56530291c tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/ips" status: 200 len: 146 microversion: 2.1 time: 0.068518 Dec 14 10:15:01.928396 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 435/919] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Dec 14 10:15:01 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/ips => generated 146 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:15:02.398613 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c56f7cfb-d34d-4dea-88c7-40323f7c36c1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:02.399430 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c56f7cfb-d34d-4dea-88c7-40323f7c36c1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:02.407383 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c56f7cfb-d34d-4dea-88c7-40323f7c36c1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:02.407825 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c56f7cfb-d34d-4dea-88c7-40323f7c36c1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:02.408575 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c56f7cfb-d34d-4dea-88c7-40323f7c36c1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:02.409002 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c56f7cfb-d34d-4dea-88c7-40323f7c36c1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:02.608348 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c56f7cfb-d34d-4dea-88c7-40323f7c36c1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:02.618415 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c56f7cfb-d34d-4dea-88c7-40323f7c36c1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:02.620172 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c56f7cfb-d34d-4dea-88c7-40323f7c36c1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:02.621412 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c56f7cfb-d34d-4dea-88c7-40323f7c36c1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1805 microversion: 2.20 time: 0.227053 Dec 14 10:15:02.622090 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 485/920] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:15:02 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1805 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:15:03.371705 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-50980093-3a78-414e-828f-eaa9354f9437 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59cdda45-a9c8-4e4e-9009-e4b4d9c58151"}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:15:03.372748 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-50980093-3a78-414e-828f-eaa9354f9437 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:03.380293 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-50980093-3a78-414e-828f-eaa9354f9437 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:03.380743 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-50980093-3a78-414e-828f-eaa9354f9437 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:03.381502 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-50980093-3a78-414e-828f-eaa9354f9437 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:03.381936 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-50980093-3a78-414e-828f-eaa9354f9437 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:03.641472 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-ae9a94d6-4300-46f7-b995-bcbeb56edf1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:03.642104 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-ae9a94d6-4300-46f7-b995-bcbeb56edf1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:03.651784 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ae9a94d6-4300-46f7-b995-bcbeb56edf1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:03.652263 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ae9a94d6-4300-46f7-b995-bcbeb56edf1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:03.653277 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ae9a94d6-4300-46f7-b995-bcbeb56edf1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:03.653781 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ae9a94d6-4300-46f7-b995-bcbeb56edf1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:03.721127 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-50980093-3a78-414e-828f-eaa9354f9437 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.353613 Dec 14 10:15:03.721802 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 436/921] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Dec 14 10:15:03 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:15:03.860398 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-ae9a94d6-4300-46f7-b995-bcbeb56edf1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:03.870636 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-ae9a94d6-4300-46f7-b995-bcbeb56edf1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:03.872118 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-ae9a94d6-4300-46f7-b995-bcbeb56edf1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:03.873228 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-ae9a94d6-4300-46f7-b995-bcbeb56edf1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1792 microversion: 2.20 time: 0.235532 Dec 14 10:15:03.873774 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 486/922] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:15:03 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1792 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:15:10.402801 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3567f38d-e45f-4457-aebe-bae8b0c72024 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:10.403829 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3567f38d-e45f-4457-aebe-bae8b0c72024 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:10.411695 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3567f38d-e45f-4457-aebe-bae8b0c72024 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:10.412131 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3567f38d-e45f-4457-aebe-bae8b0c72024 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:10.412880 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3567f38d-e45f-4457-aebe-bae8b0c72024 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:10.413309 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3567f38d-e45f-4457-aebe-bae8b0c72024 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:10.475898 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3567f38d-e45f-4457-aebe-bae8b0c72024 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078053 Dec 14 10:15:10.476497 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 437/923] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:15:10 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:15:10.486815 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-b0061787-3bab-4639-b8e9-86c11148771b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:10.487320 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-b0061787-3bab-4639-b8e9-86c11148771b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:10.495191 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b0061787-3bab-4639-b8e9-86c11148771b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:10.495637 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b0061787-3bab-4639-b8e9-86c11148771b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:10.496406 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b0061787-3bab-4639-b8e9-86c11148771b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:10.496871 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b0061787-3bab-4639-b8e9-86c11148771b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:10.560631 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-b0061787-3bab-4639-b8e9-86c11148771b tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments/59cdda45-a9c8-4e4e-9009-e4b4d9c58151" status: 200 len: 194 microversion: 2.1 time: 0.077558 Dec 14 10:15:10.561217 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 487/924] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Dec 14 10:15:10 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments/59cdda45-a9c8-4e4e-9009-e4b4d9c58151 => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:15:12.002271 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-7eaf17d6-74dc-4d8a-8946-5755a79b52d4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b76e0ad-18cd-466b-851c-ff77fc4480ef"}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:15:12.003318 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-7eaf17d6-74dc-4d8a-8946-5755a79b52d4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:12.010507 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7eaf17d6-74dc-4d8a-8946-5755a79b52d4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:12.010956 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7eaf17d6-74dc-4d8a-8946-5755a79b52d4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:12.011719 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7eaf17d6-74dc-4d8a-8946-5755a79b52d4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:12.012152 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7eaf17d6-74dc-4d8a-8946-5755a79b52d4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:12.344461 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-7eaf17d6-74dc-4d8a-8946-5755a79b52d4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345836 Dec 14 10:15:12.345307 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 438/925] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Dec 14 10:15:11 2021] POST /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:15:20.094958 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-3ac78aba-abab-4c7e-92c2-11351352d4a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:20.095872 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-3ac78aba-abab-4c7e-92c2-11351352d4a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:20.103584 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3ac78aba-abab-4c7e-92c2-11351352d4a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:20.104737 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3ac78aba-abab-4c7e-92c2-11351352d4a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:20.105508 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3ac78aba-abab-4c7e-92c2-11351352d4a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:20.105943 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3ac78aba-abab-4c7e-92c2-11351352d4a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:20.172922 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-3ac78aba-abab-4c7e-92c2-11351352d4a7 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.081607 Dec 14 10:15:20.173491 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 488/926] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:15:20 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments => generated 371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:15:20.446094 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-98901c86-afa7-420d-b025-4cbc3ca89e76 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:20.446676 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-98901c86-afa7-420d-b025-4cbc3ca89e76 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:20.455677 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-98901c86-afa7-420d-b025-4cbc3ca89e76 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:20.456153 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-98901c86-afa7-420d-b025-4cbc3ca89e76 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:20.456926 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-98901c86-afa7-420d-b025-4cbc3ca89e76 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:20.457359 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-98901c86-afa7-420d-b025-4cbc3ca89e76 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:20.522617 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-98901c86-afa7-420d-b025-4cbc3ca89e76 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments/59cdda45-a9c8-4e4e-9009-e4b4d9c58151" status: 200 len: 194 microversion: 2.1 time: 0.080683 Dec 14 10:15:20.523181 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 439/927] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Dec 14 10:15:20 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments/59cdda45-a9c8-4e4e-9009-e4b4d9c58151 => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:15:20.533435 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-899cba97-0720-4636-9fac-c034b810c853 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:20.533920 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-899cba97-0720-4636-9fac-c034b810c853 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:20.541088 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-899cba97-0720-4636-9fac-c034b810c853 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:20.541573 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-899cba97-0720-4636-9fac-c034b810c853 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:20.542364 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-899cba97-0720-4636-9fac-c034b810c853 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:20.542789 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-899cba97-0720-4636-9fac-c034b810c853 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:20.692148 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.objects.instance [None req-899cba97-0720-4636-9fac-c034b810c853 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lazy-loading 'services' on Instance uuid d877f71b-46a2-42d5-9289-8bc4752e2f43 {{(pid=100984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:15:20.830964 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-899cba97-0720-4636-9fac-c034b810c853 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments/59cdda45-a9c8-4e4e-9009-e4b4d9c58151" status: 202 len: 0 microversion: 2.1 time: 0.301143 Dec 14 10:15:20.831793 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 489/928] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Dec 14 10:15:20 2021] DELETE /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments/59cdda45-a9c8-4e4e-9009-e4b4d9c58151 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:15:23.084561 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6230b30a-623a-4b04-b268-09fa8f8b90b4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:23.085080 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6230b30a-623a-4b04-b268-09fa8f8b90b4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:23.093322 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6230b30a-623a-4b04-b268-09fa8f8b90b4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:23.093774 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6230b30a-623a-4b04-b268-09fa8f8b90b4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:23.094594 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6230b30a-623a-4b04-b268-09fa8f8b90b4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:23.095036 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6230b30a-623a-4b04-b268-09fa8f8b90b4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:23.160652 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6230b30a-623a-4b04-b268-09fa8f8b90b4 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments/0b76e0ad-18cd-466b-851c-ff77fc4480ef" status: 200 len: 194 microversion: 2.1 time: 0.079818 Dec 14 10:15:23.161264 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 440/929] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Dec 14 10:15:23 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments/0b76e0ad-18cd-466b-851c-ff77fc4480ef => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:15:23.171891 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8760f44d-972d-4b60-9b40-ee0d9bf261ea tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:23.172499 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-8760f44d-972d-4b60-9b40-ee0d9bf261ea tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:23.179959 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8760f44d-972d-4b60-9b40-ee0d9bf261ea tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:23.180398 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8760f44d-972d-4b60-9b40-ee0d9bf261ea tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:23.181160 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8760f44d-972d-4b60-9b40-ee0d9bf261ea tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:23.181590 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8760f44d-972d-4b60-9b40-ee0d9bf261ea tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:23.329155 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.objects.instance [None req-8760f44d-972d-4b60-9b40-ee0d9bf261ea tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lazy-loading 'services' on Instance uuid d877f71b-46a2-42d5-9289-8bc4752e2f43 {{(pid=100984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:15:23.483347 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8760f44d-972d-4b60-9b40-ee0d9bf261ea tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments/0b76e0ad-18cd-466b-851c-ff77fc4480ef" status: 202 len: 0 microversion: 2.1 time: 0.315353 Dec 14 10:15:23.483918 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 490/930] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Dec 14 10:15:23 2021] DELETE /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments/0b76e0ad-18cd-466b-851c-ff77fc4480ef => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:15:24.733410 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-8739a94b-cff8-4735-9811-e2a2759438f0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:24.734342 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-8739a94b-cff8-4735-9811-e2a2759438f0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:24.741343 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8739a94b-cff8-4735-9811-e2a2759438f0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:24.741786 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8739a94b-cff8-4735-9811-e2a2759438f0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:24.742580 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8739a94b-cff8-4735-9811-e2a2759438f0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:24.743011 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8739a94b-cff8-4735-9811-e2a2759438f0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:24.804701 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-8739a94b-cff8-4735-9811-e2a2759438f0 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074979 Dec 14 10:15:24.805437 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 441/931] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:15:24 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 10:15:24.967288 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-9a55d36e-50b1-4d1e-9a0e-bf74813aaeab tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:24.968267 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-9a55d36e-50b1-4d1e-9a0e-bf74813aaeab tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:24.975607 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9a55d36e-50b1-4d1e-9a0e-bf74813aaeab tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:24.976052 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9a55d36e-50b1-4d1e-9a0e-bf74813aaeab tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:24.976813 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9a55d36e-50b1-4d1e-9a0e-bf74813aaeab tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:24.977244 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9a55d36e-50b1-4d1e-9a0e-bf74813aaeab tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:25.041372 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-9a55d36e-50b1-4d1e-9a0e-bf74813aaeab tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078730 Dec 14 10:15:25.041926 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 491/932] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Dec 14 10:15:24 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 14 10:15:25.128516 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e8ebc8bd-4410-495d-bc7b-33225f4daa96 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:25.129020 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e8ebc8bd-4410-495d-bc7b-33225f4daa96 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:25.137109 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e8ebc8bd-4410-495d-bc7b-33225f4daa96 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:25.137573 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e8ebc8bd-4410-495d-bc7b-33225f4daa96 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:25.138370 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e8ebc8bd-4410-495d-bc7b-33225f4daa96 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:25.138809 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e8ebc8bd-4410-495d-bc7b-33225f4daa96 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:25.198229 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e8ebc8bd-4410-495d-bc7b-33225f4daa96 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Going to try to terminate instance {{(pid=100985) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:15:25.309821 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e8ebc8bd-4410-495d-bc7b-33225f4daa96 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43" status: 204 len: 0 microversion: 2.1 time: 0.183579 Dec 14 10:15:25.310630 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 442/933] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:15:25 2021] DELETE /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 10:15:25.318582 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-3f6f2329-9194-4bf5-9b74-c4407d0831cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:25.319184 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-3f6f2329-9194-4bf5-9b74-c4407d0831cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:25.326961 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3f6f2329-9194-4bf5-9b74-c4407d0831cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:25.327398 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3f6f2329-9194-4bf5-9b74-c4407d0831cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:25.328149 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3f6f2329-9194-4bf5-9b74-c4407d0831cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:25.328574 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3f6f2329-9194-4bf5-9b74-c4407d0831cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:25.519952 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-3f6f2329-9194-4bf5-9b74-c4407d0831cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:25.528481 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-3f6f2329-9194-4bf5-9b74-c4407d0831cf tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43" status: 200 len: 1674 microversion: 2.1 time: 0.213585 Dec 14 10:15:25.529041 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 492/934] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:15:25 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43 => generated 1674 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:15:26.546168 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-122c7639-41b7-493c-b833-b96d6deef187 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:26.546866 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-122c7639-41b7-493c-b833-b96d6deef187 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:26.553979 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-122c7639-41b7-493c-b833-b96d6deef187 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:26.554437 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-122c7639-41b7-493c-b833-b96d6deef187 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:26.555201 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-122c7639-41b7-493c-b833-b96d6deef187 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:26.555633 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-122c7639-41b7-493c-b833-b96d6deef187 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:26.754717 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-122c7639-41b7-493c-b833-b96d6deef187 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:26.763366 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-122c7639-41b7-493c-b833-b96d6deef187 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43" status: 200 len: 1674 microversion: 2.1 time: 0.221411 Dec 14 10:15:26.763919 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 443/935] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:15:26 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43 => generated 1674 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:15:27.780887 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a3f752af-4bdf-4421-8899-4522d9e2ff56 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:27.781509 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-a3f752af-4bdf-4421-8899-4522d9e2ff56 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:27.788754 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a3f752af-4bdf-4421-8899-4522d9e2ff56 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:27.789190 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a3f752af-4bdf-4421-8899-4522d9e2ff56 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:27.789943 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a3f752af-4bdf-4421-8899-4522d9e2ff56 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:27.790402 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a3f752af-4bdf-4421-8899-4522d9e2ff56 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:27.990477 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-a3f752af-4bdf-4421-8899-4522d9e2ff56 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:27.999244 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a3f752af-4bdf-4421-8899-4522d9e2ff56 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43" status: 200 len: 1674 microversion: 2.1 time: 0.222475 Dec 14 10:15:28.000005 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 493/936] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:15:27 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43 => generated 1674 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:15:28.755585 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-fe156891-b453-477d-a10f-fab5018246f3 req-93435f1f-b360-4045-8ed1-b49d0431aa02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d877f71b-46a2-42d5-9289-8bc4752e2f43", "name": "network-vif-deleted", "tag": "12b65534-dfb7-42d4-8669-166c24dd76e5"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:15:28.757281 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:15:28.757281 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:15:28.767075 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-fe156891-b453-477d-a10f-fab5018246f3 req-93435f1f-b360-4045-8ed1-b49d0431aa02 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:28.767523 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-fe156891-b453-477d-a10f-fab5018246f3 req-93435f1f-b360-4045-8ed1-b49d0431aa02 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:28.791192 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-fe156891-b453-477d-a10f-fab5018246f3 req-93435f1f-b360-4045-8ed1-b49d0431aa02 service nova] Creating event network-vif-deleted:12b65534-dfb7-42d4-8669-166c24dd76e5 for instance d877f71b-46a2-42d5-9289-8bc4752e2f43 on hv-cinder-81888 Dec 14 10:15:28.798208 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-fe156891-b453-477d-a10f-fab5018246f3 req-93435f1f-b360-4045-8ed1-b49d0431aa02 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046627 Dec 14 10:15:28.799109 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 444/937] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:15:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:15:29.016514 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-9d7db2ba-0a29-4f4d-9c4f-cf60c192a633 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:29.017151 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-9d7db2ba-0a29-4f4d-9c4f-cf60c192a633 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:29.024679 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9d7db2ba-0a29-4f4d-9c4f-cf60c192a633 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:29.025125 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9d7db2ba-0a29-4f4d-9c4f-cf60c192a633 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:29.026195 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9d7db2ba-0a29-4f4d-9c4f-cf60c192a633 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:29.026632 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9d7db2ba-0a29-4f4d-9c4f-cf60c192a633 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:29.098364 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9d7db2ba-0a29-4f4d-9c4f-cf60c192a633 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:29.098802 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9d7db2ba-0a29-4f4d-9c4f-cf60c192a633 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:29.099248 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.objects.instance [None req-9d7db2ba-0a29-4f4d-9c4f-cf60c192a633 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lazy-loading 'fault' on Instance uuid d877f71b-46a2-42d5-9289-8bc4752e2f43 {{(pid=100984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:15:29.163589 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-9d7db2ba-0a29-4f4d-9c4f-cf60c192a633 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bd13a8087149c797727e140ec7d387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bc312475a4c749b82c1f077f8fff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:29.174297 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-9d7db2ba-0a29-4f4d-9c4f-cf60c192a633 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43" status: 200 len: 1328 microversion: 2.1 time: 0.161324 Dec 14 10:15:29.174933 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 494/938] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:15:29 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43 => generated 1328 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:15:30.191736 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c493b2d0-409a-4896-b569-9ed3f3144361 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:30.192538 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c493b2d0-409a-4896-b569-9ed3f3144361 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:30.200848 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c493b2d0-409a-4896-b569-9ed3f3144361 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:30.201581 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c493b2d0-409a-4896-b569-9ed3f3144361 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:30.202559 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c493b2d0-409a-4896-b569-9ed3f3144361 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:30.203078 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c493b2d0-409a-4896-b569-9ed3f3144361 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:30.254175 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-c493b2d0-409a-4896-b569-9ed3f3144361 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] HTTP exception thrown: Instance d877f71b-46a2-42d5-9289-8bc4752e2f43 could not be found. Dec 14 10:15:30.254776 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c493b2d0-409a-4896-b569-9ed3f3144361 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Returning 404 to user: Instance d877f71b-46a2-42d5-9289-8bc4752e2f43 could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:15:30.255643 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c493b2d0-409a-4896-b569-9ed3f3144361 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43" status: 404 len: 111 microversion: 2.1 time: 0.068166 Dec 14 10:15:30.256171 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 445/939] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:15:30 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:15:30.264798 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-6457c5f8-f34e-4046-a414-fdc61e320e63 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '.version_select at 0x7fb179425040>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:30.281343 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-6457c5f8-f34e-4046-a414-fdc61e320e63 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1517861628" status: 202 len: 0 microversion: 2.1 time: 0.020709 Dec 14 10:15:30.281873 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 495/940] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Dec 14 10:15:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1517861628 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 14 10:15:33.777035 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-0762f95a-76af-424d-b95e-a32b9d040180 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:33.777523 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-0762f95a-76af-424d-b95e-a32b9d040180 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:33.784710 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0762f95a-76af-424d-b95e-a32b9d040180 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:33.785160 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0762f95a-76af-424d-b95e-a32b9d040180 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:33.785913 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0762f95a-76af-424d-b95e-a32b9d040180 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:33.786369 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0762f95a-76af-424d-b95e-a32b9d040180 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:33.835750 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-0762f95a-76af-424d-b95e-a32b9d040180 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] HTTP exception thrown: Instance d877f71b-46a2-42d5-9289-8bc4752e2f43 could not be found. Dec 14 10:15:33.836330 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-0762f95a-76af-424d-b95e-a32b9d040180 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Returning 404 to user: Instance d877f71b-46a2-42d5-9289-8bc4752e2f43 could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:15:33.837131 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-0762f95a-76af-424d-b95e-a32b9d040180 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43" status: 404 len: 111 microversion: 2.1 time: 0.064169 Dec 14 10:15:33.837652 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 446/941] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:15:33 2021] DELETE /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:15:33.845462 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e975558e-1f77-436a-a278-dc5d7218869f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:33.846133 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e975558e-1f77-436a-a278-dc5d7218869f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: d877f71b-46a2-42d5-9289-8bc4752e2f43] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:33.853214 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e975558e-1f77-436a-a278-dc5d7218869f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:33.853655 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e975558e-1f77-436a-a278-dc5d7218869f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:33.854456 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e975558e-1f77-436a-a278-dc5d7218869f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:33.854888 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e975558e-1f77-436a-a278-dc5d7218869f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:33.903842 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-e975558e-1f77-436a-a278-dc5d7218869f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] HTTP exception thrown: Instance d877f71b-46a2-42d5-9289-8bc4752e2f43 could not be found. Dec 14 10:15:33.904418 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e975558e-1f77-436a-a278-dc5d7218869f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Returning 404 to user: Instance d877f71b-46a2-42d5-9289-8bc4752e2f43 could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:15:33.905226 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e975558e-1f77-436a-a278-dc5d7218869f tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43" status: 404 len: 111 microversion: 2.1 time: 0.063444 Dec 14 10:15:33.905763 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 496/942] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:15:33 2021] GET /compute/v2.1/servers/d877f71b-46a2-42d5-9289-8bc4752e2f43 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:15:35.126456 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-72c926f8-aa9f-406f-8515-2877cc58854e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:35.126932 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-72c926f8-aa9f-406f-8515-2877cc58854e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:35.133972 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-72c926f8-aa9f-406f-8515-2877cc58854e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:35.134436 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-72c926f8-aa9f-406f-8515-2877cc58854e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:35.135186 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-72c926f8-aa9f-406f-8515-2877cc58854e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:35.135614 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-72c926f8-aa9f-406f-8515-2877cc58854e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:35.187328 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-72c926f8-aa9f-406f-8515-2877cc58854e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] HTTP exception thrown: Instance 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f could not be found. Dec 14 10:15:35.187914 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-72c926f8-aa9f-406f-8515-2877cc58854e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Returning 404 to user: Instance 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:15:35.188730 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-72c926f8-aa9f-406f-8515-2877cc58854e tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 404 len: 111 microversion: 2.1 time: 0.066014 Dec 14 10:15:35.189234 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 447/943] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:15:35 2021] DELETE /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:15:35.196825 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-90798f2e-cf6c-44af-8e6c-6ce9217e6677 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:35.197425 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-90798f2e-cf6c-44af-8e6c-6ce9217e6677 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] [instance: 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:35.204934 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-90798f2e-cf6c-44af-8e6c-6ce9217e6677 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:35.205374 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-90798f2e-cf6c-44af-8e6c-6ce9217e6677 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:35.206170 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-90798f2e-cf6c-44af-8e6c-6ce9217e6677 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:35.206599 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-90798f2e-cf6c-44af-8e6c-6ce9217e6677 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:35.255169 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-90798f2e-cf6c-44af-8e6c-6ce9217e6677 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] HTTP exception thrown: Instance 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f could not be found. Dec 14 10:15:35.255736 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-90798f2e-cf6c-44af-8e6c-6ce9217e6677 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] Returning 404 to user: Instance 2cb52f05-26bc-4f5b-be4f-f7ad45e4570f could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:15:35.256526 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-90798f2e-cf6c-44af-8e6c-6ce9217e6677 tempest-AttachVolumeTestJSON-1569184274 tempest-AttachVolumeTestJSON-1569184274-project] 10.222.0.20 "GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f" status: 404 len: 111 microversion: 2.1 time: 0.063329 Dec 14 10:15:35.257046 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 497/944] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:15:35 2021] GET /compute/v2.1/servers/2cb52f05-26bc-4f5b-be4f-f7ad45e4570f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:15:36.546858 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-eebe6b70-69ed-44e7-b3ff-9824d6b12f31 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:36.547404 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-eebe6b70-69ed-44e7-b3ff-9824d6b12f31 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:36.554551 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-eebe6b70-69ed-44e7-b3ff-9824d6b12f31 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:36.554993 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-eebe6b70-69ed-44e7-b3ff-9824d6b12f31 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:36.555756 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-eebe6b70-69ed-44e7-b3ff-9824d6b12f31 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:36.556186 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-eebe6b70-69ed-44e7-b3ff-9824d6b12f31 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:36.619517 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-eebe6b70-69ed-44e7-b3ff-9824d6b12f31 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/os-volume_attachments/f73c61cc-84e0-46b9-b743-25cb2b3200af" status: 200 len: 194 microversion: 2.20 time: 0.076554 Dec 14 10:15:36.620183 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 448/945] 10.222.0.20 () {60 vars in 1453 bytes} [Tue Dec 14 10:15:36 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/os-volume_attachments/f73c61cc-84e0-46b9-b743-25cb2b3200af => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:15:36.712125 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-dca22e9f-7d80-4038-86cd-0e8f0926df3e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:36.712679 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-dca22e9f-7d80-4038-86cd-0e8f0926df3e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:36.720032 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dca22e9f-7d80-4038-86cd-0e8f0926df3e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:36.720542 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dca22e9f-7d80-4038-86cd-0e8f0926df3e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:36.721376 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dca22e9f-7d80-4038-86cd-0e8f0926df3e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:36.721877 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dca22e9f-7d80-4038-86cd-0e8f0926df3e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:36.873649 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.objects.instance [None req-dca22e9f-7d80-4038-86cd-0e8f0926df3e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lazy-loading 'services' on Instance uuid 457d8e04-7e43-4287-8640-efedad40515d {{(pid=100984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:15:37.028691 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-dca22e9f-7d80-4038-86cd-0e8f0926df3e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "DELETE /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/os-volume_attachments/f73c61cc-84e0-46b9-b743-25cb2b3200af" status: 202 len: 0 microversion: 2.20 time: 0.319491 Dec 14 10:15:37.029903 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 498/946] 10.222.0.20 () {60 vars in 1456 bytes} [Tue Dec 14 10:15:36 2021] DELETE /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/os-volume_attachments/f73c61cc-84e0-46b9-b743-25cb2b3200af => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 14 10:15:37.038637 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-15657d0b-5cab-4c17-aa66-a86f583b04a0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:37.039701 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-15657d0b-5cab-4c17-aa66-a86f583b04a0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:37.048555 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-15657d0b-5cab-4c17-aa66-a86f583b04a0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:37.049347 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-15657d0b-5cab-4c17-aa66-a86f583b04a0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:37.050426 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-15657d0b-5cab-4c17-aa66-a86f583b04a0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:37.051142 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-15657d0b-5cab-4c17-aa66-a86f583b04a0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:37.133465 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-15657d0b-5cab-4c17-aa66-a86f583b04a0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098699 Dec 14 10:15:37.134141 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 449/947] 10.222.0.20 () {60 vars in 1342 bytes} [Tue Dec 14 10:15:37 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:15:38.145707 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-9802e551-68d4-426c-81a7-0e100a323539 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:38.146729 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-9802e551-68d4-426c-81a7-0e100a323539 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:38.157314 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9802e551-68d4-426c-81a7-0e100a323539 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:38.158051 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9802e551-68d4-426c-81a7-0e100a323539 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:38.158823 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9802e551-68d4-426c-81a7-0e100a323539 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:38.159287 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9802e551-68d4-426c-81a7-0e100a323539 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:38.228596 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-9802e551-68d4-426c-81a7-0e100a323539 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.086993 Dec 14 10:15:38.229355 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 499/948] 10.222.0.20 () {60 vars in 1342 bytes} [Tue Dec 14 10:15:38 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:15:38.317164 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-7aef51d0-7326-46da-9cba-2acbdea669cb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:38.317689 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-7aef51d0-7326-46da-9cba-2acbdea669cb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:38.324589 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7aef51d0-7326-46da-9cba-2acbdea669cb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:38.325038 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7aef51d0-7326-46da-9cba-2acbdea669cb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:38.325857 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7aef51d0-7326-46da-9cba-2acbdea669cb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:38.326306 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7aef51d0-7326-46da-9cba-2acbdea669cb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:38.389135 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-7aef51d0-7326-46da-9cba-2acbdea669cb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Going to try to terminate instance {{(pid=100985) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:15:38.504696 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-7aef51d0-7326-46da-9cba-2acbdea669cb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "DELETE /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 204 len: 0 microversion: 2.20 time: 0.190844 Dec 14 10:15:38.505289 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 450/949] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Dec 14 10:15:38 2021] DELETE /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 14 10:15:38.514674 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1da89ab6-edce-465d-9a35-b29e8b5fa2d4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:38.515620 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1da89ab6-edce-465d-9a35-b29e8b5fa2d4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:38.523653 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1da89ab6-edce-465d-9a35-b29e8b5fa2d4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:38.524360 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1da89ab6-edce-465d-9a35-b29e8b5fa2d4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:38.525369 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1da89ab6-edce-465d-9a35-b29e8b5fa2d4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:38.526409 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1da89ab6-edce-465d-9a35-b29e8b5fa2d4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:38.749767 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1da89ab6-edce-465d-9a35-b29e8b5fa2d4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:38.758444 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1da89ab6-edce-465d-9a35-b29e8b5fa2d4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:38.759920 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1da89ab6-edce-465d-9a35-b29e8b5fa2d4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:38.761027 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1da89ab6-edce-465d-9a35-b29e8b5fa2d4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1720 microversion: 2.20 time: 0.250690 Dec 14 10:15:38.761582 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 500/950] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:15:38 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1720 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:15:39.781452 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-7e311d1e-812d-4a93-9ee8-ad14e0f71251 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:39.782182 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-7e311d1e-812d-4a93-9ee8-ad14e0f71251 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:39.789465 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7e311d1e-812d-4a93-9ee8-ad14e0f71251 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:39.790301 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7e311d1e-812d-4a93-9ee8-ad14e0f71251 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:39.791097 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7e311d1e-812d-4a93-9ee8-ad14e0f71251 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:39.791528 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7e311d1e-812d-4a93-9ee8-ad14e0f71251 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:40.251397 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-7e311d1e-812d-4a93-9ee8-ad14e0f71251 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:40.259922 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-7e311d1e-812d-4a93-9ee8-ad14e0f71251 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:40.261427 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-7e311d1e-812d-4a93-9ee8-ad14e0f71251 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:40.262631 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-7e311d1e-812d-4a93-9ee8-ad14e0f71251 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1720 microversion: 2.20 time: 0.485434 Dec 14 10:15:40.263238 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 451/951] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:15:39 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1720 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:15:41.281468 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c97ff6fe-1e1a-45bd-ad95-8ad42a49e83d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:41.282102 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c97ff6fe-1e1a-45bd-ad95-8ad42a49e83d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:41.289308 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c97ff6fe-1e1a-45bd-ad95-8ad42a49e83d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:41.289748 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c97ff6fe-1e1a-45bd-ad95-8ad42a49e83d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:41.290533 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c97ff6fe-1e1a-45bd-ad95-8ad42a49e83d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:41.290954 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c97ff6fe-1e1a-45bd-ad95-8ad42a49e83d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:41.411852 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c97ff6fe-1e1a-45bd-ad95-8ad42a49e83d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:41.422092 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c97ff6fe-1e1a-45bd-ad95-8ad42a49e83d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:41.423670 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c97ff6fe-1e1a-45bd-ad95-8ad42a49e83d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:41.424888 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c97ff6fe-1e1a-45bd-ad95-8ad42a49e83d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1655 microversion: 2.20 time: 0.147974 Dec 14 10:15:41.425712 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 501/952] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:15:41 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1655 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:15:41.942739 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-ae3f3b50-0bcc-4672-ac26-e3a641c73151 req-c89c081f-eaa1-42a5-85a4-dd9011da3c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "457d8e04-7e43-4287-8640-efedad40515d", "name": "network-vif-deleted", "tag": "07c89ab1-3f66-4963-95e3-1048fc17638b"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:15:41.944904 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:15:41.944904 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:15:41.956741 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-ae3f3b50-0bcc-4672-ac26-e3a641c73151 req-c89c081f-eaa1-42a5-85a4-dd9011da3c37 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:41.957478 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-ae3f3b50-0bcc-4672-ac26-e3a641c73151 req-c89c081f-eaa1-42a5-85a4-dd9011da3c37 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:41.983939 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-ae3f3b50-0bcc-4672-ac26-e3a641c73151 req-c89c081f-eaa1-42a5-85a4-dd9011da3c37 service nova] Creating event network-vif-deleted:07c89ab1-3f66-4963-95e3-1048fc17638b for instance 457d8e04-7e43-4287-8640-efedad40515d on hv-cinder-81888 Dec 14 10:15:42.005516 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-ae3f3b50-0bcc-4672-ac26-e3a641c73151 req-c89c081f-eaa1-42a5-85a4-dd9011da3c37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067128 Dec 14 10:15:42.006542 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 452/953] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:15:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:15:42.443064 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-3f54acf4-5ed8-48d2-8b20-40afa7c25237 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:42.443832 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-3f54acf4-5ed8-48d2-8b20-40afa7c25237 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:42.452259 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3f54acf4-5ed8-48d2-8b20-40afa7c25237 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:42.452992 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3f54acf4-5ed8-48d2-8b20-40afa7c25237 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:42.454051 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3f54acf4-5ed8-48d2-8b20-40afa7c25237 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:42.454703 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3f54acf4-5ed8-48d2-8b20-40afa7c25237 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:42.549186 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3f54acf4-5ed8-48d2-8b20-40afa7c25237 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:42.549632 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3f54acf4-5ed8-48d2-8b20-40afa7c25237 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:42.550119 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.objects.instance [None req-3f54acf4-5ed8-48d2-8b20-40afa7c25237 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lazy-loading 'fault' on Instance uuid 457d8e04-7e43-4287-8640-efedad40515d {{(pid=100984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:15:42.611625 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-3f54acf4-5ed8-48d2-8b20-40afa7c25237 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:42.620139 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-3f54acf4-5ed8-48d2-8b20-40afa7c25237 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:42.622551 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-3f54acf4-5ed8-48d2-8b20-40afa7c25237 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:42.623940 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-3f54acf4-5ed8-48d2-8b20-40afa7c25237 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 200 len: 1370 microversion: 2.20 time: 0.184518 Dec 14 10:15:42.626007 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 502/954] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:15:42 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:15:43.642901 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-820e72b4-db31-4221-9043-94e73a28a9d8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:43.644217 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-820e72b4-db31-4221-9043-94e73a28a9d8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:43.652641 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-820e72b4-db31-4221-9043-94e73a28a9d8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:43.653106 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-820e72b4-db31-4221-9043-94e73a28a9d8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:43.653880 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-820e72b4-db31-4221-9043-94e73a28a9d8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:43.654341 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-820e72b4-db31-4221-9043-94e73a28a9d8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:43.706494 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-820e72b4-db31-4221-9043-94e73a28a9d8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] HTTP exception thrown: Instance 457d8e04-7e43-4287-8640-efedad40515d could not be found. Dec 14 10:15:43.707085 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-820e72b4-db31-4221-9043-94e73a28a9d8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Returning 404 to user: Instance 457d8e04-7e43-4287-8640-efedad40515d could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:15:43.707898 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-820e72b4-db31-4221-9043-94e73a28a9d8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 404 len: 111 microversion: 2.20 time: 0.069641 Dec 14 10:15:43.708612 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 453/955] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:15:43 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 14 10:15:43.716997 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d10778ba-3f56-4b09-946a-877cf5d400ce tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '.version_select at 0x7fb1790eea60>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:43.734995 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d10778ba-3f56-4b09-946a-877cf5d400ce tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-73314762" status: 204 len: 0 microversion: 2.20 time: 0.022089 Dec 14 10:15:43.735554 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 503/956] 10.222.0.20 () {60 vars in 1255 bytes} [Tue Dec 14 10:15:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-73314762 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 14 10:15:44.921888 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-812bd831-0d67-400e-ab2b-592a11488885 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'create', calling method: .version_select at 0x7fb17a574550>, body: {"keypair": {"name": "tempest-keypair-1202415904"}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:15:44.944430 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-812bd831-0d67-400e-ab2b-592a11488885 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Getting quotas for project a0c2622fa7624094bfe5a81b02f1bcdd. Resources: {'key_pairs'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:15:44.948238 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-812bd831-0d67-400e-ab2b-592a11488885 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Getting quotas for user f659954c79f3426aaaf6612c48a84f1e and project a0c2622fa7624094bfe5a81b02f1bcdd. Resources: {'key_pairs'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:15:45.593152 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-812bd831-0d67-400e-ab2b-592a11488885 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Getting quotas for project a0c2622fa7624094bfe5a81b02f1bcdd. Resources: {'key_pairs'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:15:45.597193 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-812bd831-0d67-400e-ab2b-592a11488885 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Getting quotas for user f659954c79f3426aaaf6612c48a84f1e and project a0c2622fa7624094bfe5a81b02f1bcdd. Resources: {'key_pairs'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:15:45.610750 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-812bd831-0d67-400e-ab2b-592a11488885 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.693484 Dec 14 10:15:45.611334 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 454/957] 10.222.0.20 () {62 vars in 1198 bytes} [Tue Dec 14 10:15:44 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 695 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 14 10:15:47.479821 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-ea4488e5-3019-444e-9919-a722b375099a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-801023409", "imageRef": "5be36fdc-2baa-4efd-b830-5a5c3fd7beba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2fa2a70-4df9-45a3-be45-0c69ddeca040"}], "security_groups": [{"name": "tempest-securitygroup--1719575019"}], "key_name": "tempest-keypair-1202415904", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:15:47.612454 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.network.neutron [None req-ea4488e5-3019-444e-9919-a722b375099a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] validate_networks() for [('e2fa2a70-4df9-45a3-be45-0c69ddeca040', None, None, None)] {{(pid=100984) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:15:48.200494 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-ea4488e5-3019-444e-9919-a722b375099a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Flavor limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:15:48.201034 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-ea4488e5-3019-444e-9919-a722b375099a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Image limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:15:48.201591 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-ea4488e5-3019-444e-9919-a722b375099a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Flavor pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:15:48.202028 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-ea4488e5-3019-444e-9919-a722b375099a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Image pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:15:48.202435 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-ea4488e5-3019-444e-9919-a722b375099a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:15:48.211049 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ea4488e5-3019-444e-9919-a722b375099a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:48.211488 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ea4488e5-3019-444e-9919-a722b375099a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:48.212276 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ea4488e5-3019-444e-9919-a722b375099a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:48.212703 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ea4488e5-3019-444e-9919-a722b375099a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:48.231681 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-ea4488e5-3019-444e-9919-a722b375099a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Getting quotas for project a0c2622fa7624094bfe5a81b02f1bcdd. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:15:48.236009 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-ea4488e5-3019-444e-9919-a722b375099a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Getting quotas for user f659954c79f3426aaaf6612c48a84f1e and project a0c2622fa7624094bfe5a81b02f1bcdd. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:15:48.246551 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-ea4488e5-3019-444e-9919-a722b375099a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Going to run 1 instances... {{(pid=100984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:15:48.249442 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-ea4488e5-3019-444e-9919-a722b375099a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5be36fdc-2baa-4efd-b830-5a5c3fd7beba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:15:48.297101 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-ea4488e5-3019-444e-9919-a722b375099a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.821749 Dec 14 10:15:48.298389 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 504/958] 10.222.0.20 () {62 vars in 1187 bytes} [Tue Dec 14 10:15:47 2021] POST /compute/v2.1/servers => generated 402 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 14 10:15:48.309726 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f427d239-a4e3-4b6a-b8dc-3835a7972004 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:48.311291 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f427d239-a4e3-4b6a-b8dc-3835a7972004 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:48.471623 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f427d239-a4e3-4b6a-b8dc-3835a7972004 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:48.480402 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f427d239-a4e3-4b6a-b8dc-3835a7972004 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:48.482664 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f427d239-a4e3-4b6a-b8dc-3835a7972004 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:48.484055 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f427d239-a4e3-4b6a-b8dc-3835a7972004 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1281 microversion: 2.20 time: 0.179150 Dec 14 10:15:48.484887 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 455/959] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:15:48 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1281 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:15:49.502961 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-3aa2b1a9-b9b7-4295-b962-0c2b43ab560b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:49.506699 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-3aa2b1a9-b9b7-4295-b962-0c2b43ab560b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:49.517657 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3aa2b1a9-b9b7-4295-b962-0c2b43ab560b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:49.518474 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3aa2b1a9-b9b7-4295-b962-0c2b43ab560b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:49.519929 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3aa2b1a9-b9b7-4295-b962-0c2b43ab560b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:49.520737 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3aa2b1a9-b9b7-4295-b962-0c2b43ab560b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:49.662041 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-3aa2b1a9-b9b7-4295-b962-0c2b43ab560b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:49.672130 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-3aa2b1a9-b9b7-4295-b962-0c2b43ab560b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:49.673699 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-3aa2b1a9-b9b7-4295-b962-0c2b43ab560b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:49.674956 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-3aa2b1a9-b9b7-4295-b962-0c2b43ab560b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1339 microversion: 2.20 time: 0.175900 Dec 14 10:15:49.675780 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 505/960] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:15:49 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1339 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:15:50.694623 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e670c6b2-6840-4025-ba7b-eaf4103b2cca tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:50.696004 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e670c6b2-6840-4025-ba7b-eaf4103b2cca tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:50.705408 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e670c6b2-6840-4025-ba7b-eaf4103b2cca tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:50.706175 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e670c6b2-6840-4025-ba7b-eaf4103b2cca tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:50.707191 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e670c6b2-6840-4025-ba7b-eaf4103b2cca tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:50.707863 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e670c6b2-6840-4025-ba7b-eaf4103b2cca tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:51.234391 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-e670c6b2-6840-4025-ba7b-eaf4103b2cca tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:51.243087 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-e670c6b2-6840-4025-ba7b-eaf4103b2cca tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:51.244633 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-e670c6b2-6840-4025-ba7b-eaf4103b2cca tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:51.245771 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e670c6b2-6840-4025-ba7b-eaf4103b2cca tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1407 microversion: 2.20 time: 0.554932 Dec 14 10:15:51.246303 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 456/961] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:15:50 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1407 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:15:51.465315 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-7115f79d-fbc4-4426-906a-addf080a0fdc req-717cd438-1643-468b-a4f0-8e6ea20c1980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc8d226a-4c08-4a07-94a7-f7c17c509a27", "tag": "aa6402ff-8882-4a58-b152-b056853240b9"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:15:51.468440 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:15:51.468440 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:15:51.478323 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-7115f79d-fbc4-4426-906a-addf080a0fdc req-717cd438-1643-468b-a4f0-8e6ea20c1980 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:51.478831 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-7115f79d-fbc4-4426-906a-addf080a0fdc req-717cd438-1643-468b-a4f0-8e6ea20c1980 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:51.510211 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-7115f79d-fbc4-4426-906a-addf080a0fdc req-717cd438-1643-468b-a4f0-8e6ea20c1980 service nova] Creating event network-changed:aa6402ff-8882-4a58-b152-b056853240b9 for instance cc8d226a-4c08-4a07-94a7-f7c17c509a27 on hv-cinder-81888 Dec 14 10:15:51.516202 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-7115f79d-fbc4-4426-906a-addf080a0fdc req-717cd438-1643-468b-a4f0-8e6ea20c1980 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056422 Dec 14 10:15:51.517353 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 506/962] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:15:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:15:52.265019 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-45b9ee06-d70a-44c5-bd23-9a3bc5ecfe3b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:52.265625 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-45b9ee06-d70a-44c5-bd23-9a3bc5ecfe3b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:52.272955 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-45b9ee06-d70a-44c5-bd23-9a3bc5ecfe3b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:52.273397 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-45b9ee06-d70a-44c5-bd23-9a3bc5ecfe3b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:52.274188 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-45b9ee06-d70a-44c5-bd23-9a3bc5ecfe3b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:52.274619 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-45b9ee06-d70a-44c5-bd23-9a3bc5ecfe3b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:52.660336 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-45b9ee06-d70a-44c5-bd23-9a3bc5ecfe3b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:52.676838 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-45b9ee06-d70a-44c5-bd23-9a3bc5ecfe3b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:52.678371 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-45b9ee06-d70a-44c5-bd23-9a3bc5ecfe3b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:52.679451 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-45b9ee06-d70a-44c5-bd23-9a3bc5ecfe3b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1407 microversion: 2.20 time: 0.418902 Dec 14 10:15:52.680148 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 457/963] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:15:52 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1407 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:15:53.698568 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c0e1275e-f587-4a6c-9362-71b46b015c1d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:53.699289 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c0e1275e-f587-4a6c-9362-71b46b015c1d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:53.707406 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c0e1275e-f587-4a6c-9362-71b46b015c1d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:53.707851 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c0e1275e-f587-4a6c-9362-71b46b015c1d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:53.708608 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c0e1275e-f587-4a6c-9362-71b46b015c1d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:53.709039 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c0e1275e-f587-4a6c-9362-71b46b015c1d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:53.901119 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c0e1275e-f587-4a6c-9362-71b46b015c1d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:53.909935 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c0e1275e-f587-4a6c-9362-71b46b015c1d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:53.911470 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c0e1275e-f587-4a6c-9362-71b46b015c1d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:53.912525 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c0e1275e-f587-4a6c-9362-71b46b015c1d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1407 microversion: 2.20 time: 0.218188 Dec 14 10:15:53.913065 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 507/964] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:15:53 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:15:54.930050 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-de712cc0-cd05-4f10-87e5-390183a5cb24 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:54.930666 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-de712cc0-cd05-4f10-87e5-390183a5cb24 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:54.939144 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-de712cc0-cd05-4f10-87e5-390183a5cb24 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:54.939592 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-de712cc0-cd05-4f10-87e5-390183a5cb24 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:54.940366 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-de712cc0-cd05-4f10-87e5-390183a5cb24 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:54.940804 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-de712cc0-cd05-4f10-87e5-390183a5cb24 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:55.142963 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-de712cc0-cd05-4f10-87e5-390183a5cb24 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:55.151954 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-de712cc0-cd05-4f10-87e5-390183a5cb24 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:55.153491 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-de712cc0-cd05-4f10-87e5-390183a5cb24 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:55.155176 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-de712cc0-cd05-4f10-87e5-390183a5cb24 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1407 microversion: 2.20 time: 0.228979 Dec 14 10:15:55.155941 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 458/965] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:15:54 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:15:56.173068 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e31bb684-376c-4e3c-9991-4d61a7afa0f9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:56.173665 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e31bb684-376c-4e3c-9991-4d61a7afa0f9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:56.180940 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e31bb684-376c-4e3c-9991-4d61a7afa0f9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:56.181679 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e31bb684-376c-4e3c-9991-4d61a7afa0f9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:56.182505 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e31bb684-376c-4e3c-9991-4d61a7afa0f9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:56.182929 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e31bb684-376c-4e3c-9991-4d61a7afa0f9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:56.387826 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e31bb684-376c-4e3c-9991-4d61a7afa0f9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:56.396822 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e31bb684-376c-4e3c-9991-4d61a7afa0f9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:56.398337 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e31bb684-376c-4e3c-9991-4d61a7afa0f9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:56.399408 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e31bb684-376c-4e3c-9991-4d61a7afa0f9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1407 microversion: 2.20 time: 0.230234 Dec 14 10:15:56.399960 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 508/966] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:15:56 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:15:57.202850 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-868fcf24-e10d-4eb5-a5d1-f84f98efa3f6 req-38146be1-8cd2-4f2a-b851-9de84349e7ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc8d226a-4c08-4a07-94a7-f7c17c509a27", "name": "network-vif-plugged", "status": "completed", "tag": "aa6402ff-8882-4a58-b152-b056853240b9"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:15:57.204666 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:15:57.204666 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:15:57.212915 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-868fcf24-e10d-4eb5-a5d1-f84f98efa3f6 req-38146be1-8cd2-4f2a-b851-9de84349e7ea service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:57.213352 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-868fcf24-e10d-4eb5-a5d1-f84f98efa3f6 req-38146be1-8cd2-4f2a-b851-9de84349e7ea service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:57.229551 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-868fcf24-e10d-4eb5-a5d1-f84f98efa3f6 req-38146be1-8cd2-4f2a-b851-9de84349e7ea service nova] Creating event network-vif-plugged:aa6402ff-8882-4a58-b152-b056853240b9 for instance cc8d226a-4c08-4a07-94a7-f7c17c509a27 on hv-cinder-81888 Dec 14 10:15:57.235032 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-868fcf24-e10d-4eb5-a5d1-f84f98efa3f6 req-38146be1-8cd2-4f2a-b851-9de84349e7ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036036 Dec 14 10:15:57.235676 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 459/967] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:15:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:15:57.417303 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1c954152-e0c2-4141-9f03-d0a6008a356e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:57.417969 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1c954152-e0c2-4141-9f03-d0a6008a356e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:57.426072 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1c954152-e0c2-4141-9f03-d0a6008a356e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:57.426501 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1c954152-e0c2-4141-9f03-d0a6008a356e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:57.427260 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1c954152-e0c2-4141-9f03-d0a6008a356e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:57.427687 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1c954152-e0c2-4141-9f03-d0a6008a356e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:57.623899 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1c954152-e0c2-4141-9f03-d0a6008a356e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:57.634429 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1c954152-e0c2-4141-9f03-d0a6008a356e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:57.635912 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1c954152-e0c2-4141-9f03-d0a6008a356e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:57.636987 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1c954152-e0c2-4141-9f03-d0a6008a356e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1407 microversion: 2.20 time: 0.223405 Dec 14 10:15:57.637535 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 509/968] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:15:57 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:15:58.657192 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b8e7c9bd-e193-457a-a8c7-5134d7b0febe tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:58.658066 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-b8e7c9bd-e193-457a-a8c7-5134d7b0febe tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:58.665465 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b8e7c9bd-e193-457a-a8c7-5134d7b0febe tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:58.665903 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b8e7c9bd-e193-457a-a8c7-5134d7b0febe tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:58.666870 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b8e7c9bd-e193-457a-a8c7-5134d7b0febe tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:58.667457 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b8e7c9bd-e193-457a-a8c7-5134d7b0febe tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:58.878256 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-b8e7c9bd-e193-457a-a8c7-5134d7b0febe tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:58.888842 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-b8e7c9bd-e193-457a-a8c7-5134d7b0febe tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:58.890685 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-b8e7c9bd-e193-457a-a8c7-5134d7b0febe tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:15:58.891825 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-b8e7c9bd-e193-457a-a8c7-5134d7b0febe tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1598 microversion: 2.20 time: 0.239566 Dec 14 10:15:58.892376 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 460/969] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:15:58 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1598 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:15:58.909835 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-dccde6ca-686e-4e83-9ed4-60b6836a1c85 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:15:58.915964 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-dccde6ca-686e-4e83-9ed4-60b6836a1c85 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:15:58.924457 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dccde6ca-686e-4e83-9ed4-60b6836a1c85 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:58.924897 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dccde6ca-686e-4e83-9ed4-60b6836a1c85 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:58.925698 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dccde6ca-686e-4e83-9ed4-60b6836a1c85 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:15:58.926218 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dccde6ca-686e-4e83-9ed4-60b6836a1c85 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:15:59.081483 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-dccde6ca-686e-4e83-9ed4-60b6836a1c85 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.175363 Dec 14 10:15:59.082134 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 510/970] 10.222.0.20 () {60 vars in 1315 bytes} [Tue Dec 14 10:15:58 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:16:01.009549 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-eb5dd9da-92e9-4854-8d82-328ae5e6b425 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:01.016044 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-efa71e61-0dea-461d-89cf-5a09973803d2 req-9c6417b0-c3b3-4547-9716-7e18492d6de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc8d226a-4c08-4a07-94a7-f7c17c509a27", "tag": "aa6402ff-8882-4a58-b152-b056853240b9"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:01.017510 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:16:01.017510 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:16:01.017814 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-eb5dd9da-92e9-4854-8d82-328ae5e6b425 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:01.029641 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-eb5dd9da-92e9-4854-8d82-328ae5e6b425 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:01.030857 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-eb5dd9da-92e9-4854-8d82-328ae5e6b425 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:01.034494 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-efa71e61-0dea-461d-89cf-5a09973803d2 req-9c6417b0-c3b3-4547-9716-7e18492d6de1 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:01.035540 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-eb5dd9da-92e9-4854-8d82-328ae5e6b425 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:01.036167 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-eb5dd9da-92e9-4854-8d82-328ae5e6b425 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:01.038458 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-efa71e61-0dea-461d-89cf-5a09973803d2 req-9c6417b0-c3b3-4547-9716-7e18492d6de1 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:01.070807 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-efa71e61-0dea-461d-89cf-5a09973803d2 req-9c6417b0-c3b3-4547-9716-7e18492d6de1 service nova] Creating event network-changed:aa6402ff-8882-4a58-b152-b056853240b9 for instance cc8d226a-4c08-4a07-94a7-f7c17c509a27 on hv-cinder-81888 Dec 14 10:16:01.084955 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-efa71e61-0dea-461d-89cf-5a09973803d2 req-9c6417b0-c3b3-4547-9716-7e18492d6de1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072932 Dec 14 10:16:01.085645 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 511/971] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:16:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:16:01.152724 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-eb5dd9da-92e9-4854-8d82-328ae5e6b425 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 14 microversion: 2.20 time: 0.146544 Dec 14 10:16:01.157107 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 461/972] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:01 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:02.165266 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f98c64bd-76be-49f9-af23-44a77f618ea9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:02.166285 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f98c64bd-76be-49f9-af23-44a77f618ea9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:02.174208 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f98c64bd-76be-49f9-af23-44a77f618ea9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:02.174656 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f98c64bd-76be-49f9-af23-44a77f618ea9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:02.175435 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f98c64bd-76be-49f9-af23-44a77f618ea9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:02.175865 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f98c64bd-76be-49f9-af23-44a77f618ea9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:02.271955 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f98c64bd-76be-49f9-af23-44a77f618ea9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 14 microversion: 2.20 time: 0.110572 Dec 14 10:16:02.272581 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 512/973] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:02 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:03.283796 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-8761d450-149f-4dc5-86bc-5ec6bcf12495 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:03.284740 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-8761d450-149f-4dc5-86bc-5ec6bcf12495 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:03.292630 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8761d450-149f-4dc5-86bc-5ec6bcf12495 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:03.293077 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8761d450-149f-4dc5-86bc-5ec6bcf12495 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:03.293847 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8761d450-149f-4dc5-86bc-5ec6bcf12495 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:03.294948 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8761d450-149f-4dc5-86bc-5ec6bcf12495 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:03.391686 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-8761d450-149f-4dc5-86bc-5ec6bcf12495 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 14 microversion: 2.20 time: 0.112435 Dec 14 10:16:03.392639 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 462/974] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:03 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:04.403413 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-fdd5a5b1-704d-47cf-aa05-2295a849ad1a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:04.405212 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-fdd5a5b1-704d-47cf-aa05-2295a849ad1a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:04.413552 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fdd5a5b1-704d-47cf-aa05-2295a849ad1a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:04.414121 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fdd5a5b1-704d-47cf-aa05-2295a849ad1a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:04.414909 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fdd5a5b1-704d-47cf-aa05-2295a849ad1a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:04.415337 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fdd5a5b1-704d-47cf-aa05-2295a849ad1a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:04.660933 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-fdd5a5b1-704d-47cf-aa05-2295a849ad1a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 14 microversion: 2.20 time: 0.261665 Dec 14 10:16:04.664078 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 513/975] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:04 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 14 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:05.672511 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-bfb2cf1f-5c9e-4e77-87b7-5f415ce56a4a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:05.673507 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-bfb2cf1f-5c9e-4e77-87b7-5f415ce56a4a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:05.681543 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bfb2cf1f-5c9e-4e77-87b7-5f415ce56a4a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:05.682049 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bfb2cf1f-5c9e-4e77-87b7-5f415ce56a4a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:05.682822 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bfb2cf1f-5c9e-4e77-87b7-5f415ce56a4a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:05.683258 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bfb2cf1f-5c9e-4e77-87b7-5f415ce56a4a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:05.774928 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-bfb2cf1f-5c9e-4e77-87b7-5f415ce56a4a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 14 microversion: 2.20 time: 0.107100 Dec 14 10:16:05.775772 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 463/976] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:05 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:06.785689 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-ea75454f-b124-4176-89e7-bfe08bffeb2b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:06.786756 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-ea75454f-b124-4176-89e7-bfe08bffeb2b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:06.794927 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ea75454f-b124-4176-89e7-bfe08bffeb2b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:06.795363 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ea75454f-b124-4176-89e7-bfe08bffeb2b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:06.799271 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ea75454f-b124-4176-89e7-bfe08bffeb2b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:06.799723 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ea75454f-b124-4176-89e7-bfe08bffeb2b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:06.894906 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-ea75454f-b124-4176-89e7-bfe08bffeb2b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 14 microversion: 2.20 time: 0.113029 Dec 14 10:16:06.896200 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 514/977] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:06 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:07.907071 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-7ae6ca65-013e-48f4-b45f-89868841d95a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:07.908097 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-7ae6ca65-013e-48f4-b45f-89868841d95a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:07.915843 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7ae6ca65-013e-48f4-b45f-89868841d95a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:07.916288 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7ae6ca65-013e-48f4-b45f-89868841d95a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:07.917044 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7ae6ca65-013e-48f4-b45f-89868841d95a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:07.917475 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7ae6ca65-013e-48f4-b45f-89868841d95a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:08.011510 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-7ae6ca65-013e-48f4-b45f-89868841d95a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 14 microversion: 2.20 time: 0.108974 Dec 14 10:16:08.015425 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 464/978] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:07 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:09.023811 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d3aebef9-3570-463f-8228-9e7172cb0ec6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:09.024724 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d3aebef9-3570-463f-8228-9e7172cb0ec6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:09.032921 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d3aebef9-3570-463f-8228-9e7172cb0ec6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:09.033392 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d3aebef9-3570-463f-8228-9e7172cb0ec6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:09.034168 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d3aebef9-3570-463f-8228-9e7172cb0ec6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:09.034607 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d3aebef9-3570-463f-8228-9e7172cb0ec6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:11.799256 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d3aebef9-3570-463f-8228-9e7172cb0ec6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 15025 microversion: 2.20 time: 2.779459 Dec 14 10:16:11.799886 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 515/979] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:09 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 15025 bytes in 2781 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:16:12.812366 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-5dfaca46-7a15-47ff-a552-9b692a08628e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:12.813291 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-5dfaca46-7a15-47ff-a552-9b692a08628e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:12.820419 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5dfaca46-7a15-47ff-a552-9b692a08628e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:12.820868 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5dfaca46-7a15-47ff-a552-9b692a08628e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:12.821635 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5dfaca46-7a15-47ff-a552-9b692a08628e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:12.822099 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5dfaca46-7a15-47ff-a552-9b692a08628e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:12.927109 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-5dfaca46-7a15-47ff-a552-9b692a08628e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 18449 microversion: 2.20 time: 0.119549 Dec 14 10:16:12.931038 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 465/980] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:12 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 18449 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:16:13.941107 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f36efe21-8a37-41a8-a63d-a462ad40ac2b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:13.943031 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f36efe21-8a37-41a8-a63d-a462ad40ac2b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:13.956497 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f36efe21-8a37-41a8-a63d-a462ad40ac2b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:13.957755 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f36efe21-8a37-41a8-a63d-a462ad40ac2b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:13.959022 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f36efe21-8a37-41a8-a63d-a462ad40ac2b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:13.959784 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f36efe21-8a37-41a8-a63d-a462ad40ac2b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:13.973150 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-28a5dada-c831-4335-9ebb-7386ba91459f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:13.973738 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-28a5dada-c831-4335-9ebb-7386ba91459f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:13.981656 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-28a5dada-c831-4335-9ebb-7386ba91459f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:13.982901 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-28a5dada-c831-4335-9ebb-7386ba91459f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:13.983854 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-28a5dada-c831-4335-9ebb-7386ba91459f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:13.984480 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-28a5dada-c831-4335-9ebb-7386ba91459f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:14.047265 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-28a5dada-c831-4335-9ebb-7386ba91459f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Going to try to terminate instance {{(pid=100985) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:16:14.074541 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f36efe21-8a37-41a8-a63d-a462ad40ac2b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 19944 microversion: 2.20 time: 0.139456 Dec 14 10:16:14.075498 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 516/981] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:13 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 19944 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:16:14.081666 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-6a4825e0-1eb1-4320-932c-8c0742675e3d req-07dd9d13-d8b9-41ef-9479-62e3d1093837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "731c99da-4633-4de9-9678-02e9fecda7b4", "tag": "eb309f74-48d9-4eb5-98e8-7571414fa330"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:14.083168 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:16:14.083168 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:16:14.092486 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-6a4825e0-1eb1-4320-932c-8c0742675e3d req-07dd9d13-d8b9-41ef-9479-62e3d1093837 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:14.092922 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-6a4825e0-1eb1-4320-932c-8c0742675e3d req-07dd9d13-d8b9-41ef-9479-62e3d1093837 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:14.108903 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-6a4825e0-1eb1-4320-932c-8c0742675e3d req-07dd9d13-d8b9-41ef-9479-62e3d1093837 service nova] Creating event network-changed:eb309f74-48d9-4eb5-98e8-7571414fa330 for instance 731c99da-4633-4de9-9678-02e9fecda7b4 on hv-cinder-81888 Dec 14 10:16:14.115135 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-6a4825e0-1eb1-4320-932c-8c0742675e3d req-07dd9d13-d8b9-41ef-9479-62e3d1093837 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037487 Dec 14 10:16:14.115727 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 517/982] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:16:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:16:14.168599 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-28a5dada-c831-4335-9ebb-7386ba91459f tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "DELETE /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 204 len: 0 microversion: 2.1 time: 0.201463 Dec 14 10:16:14.170402 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 466/983] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:16:13 2021] DELETE /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 14 10:16:14.179012 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-6263ecb8-023e-40a3-bbb1-b6420a81ab86 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:14.180103 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-6263ecb8-023e-40a3-bbb1-b6420a81ab86 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:14.188760 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6263ecb8-023e-40a3-bbb1-b6420a81ab86 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:14.189444 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6263ecb8-023e-40a3-bbb1-b6420a81ab86 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:14.190574 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6263ecb8-023e-40a3-bbb1-b6420a81ab86 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:14.191002 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6263ecb8-023e-40a3-bbb1-b6420a81ab86 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:14.392561 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-6263ecb8-023e-40a3-bbb1-b6420a81ab86 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:14.400952 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-6263ecb8-023e-40a3-bbb1-b6420a81ab86 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1568 microversion: 2.1 time: 0.226071 Dec 14 10:16:14.412092 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 518/984] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:14 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:15.087782 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-73bcf074-3402-4d95-ace1-51ec8ed49c0b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:15.088879 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-73bcf074-3402-4d95-ace1-51ec8ed49c0b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:15.097554 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-73bcf074-3402-4d95-ace1-51ec8ed49c0b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:15.098038 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-73bcf074-3402-4d95-ace1-51ec8ed49c0b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:15.098827 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-73bcf074-3402-4d95-ace1-51ec8ed49c0b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:15.099265 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-73bcf074-3402-4d95-ace1-51ec8ed49c0b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:15.211760 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-73bcf074-3402-4d95-ace1-51ec8ed49c0b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 22546 microversion: 2.20 time: 0.127865 Dec 14 10:16:15.212478 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 467/985] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:15 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 22546 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 10:16:15.418849 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-02afb8bc-71e1-4b4e-b653-61f10f77e341 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:15.419582 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-02afb8bc-71e1-4b4e-b653-61f10f77e341 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:15.427370 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-02afb8bc-71e1-4b4e-b653-61f10f77e341 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:15.427811 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-02afb8bc-71e1-4b4e-b653-61f10f77e341 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:15.428570 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-02afb8bc-71e1-4b4e-b653-61f10f77e341 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:15.428996 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-02afb8bc-71e1-4b4e-b653-61f10f77e341 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:15.627410 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-02afb8bc-71e1-4b4e-b653-61f10f77e341 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:15.635426 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-02afb8bc-71e1-4b4e-b653-61f10f77e341 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1449 microversion: 2.1 time: 0.220235 Dec 14 10:16:15.635980 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 519/986] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:15 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1449 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:16.228231 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f62def66-1232-4839-be57-f61c892e52ae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:16.229868 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f62def66-1232-4839-be57-f61c892e52ae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:16.250224 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f62def66-1232-4839-be57-f61c892e52ae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:16.251060 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f62def66-1232-4839-be57-f61c892e52ae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:16.253440 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f62def66-1232-4839-be57-f61c892e52ae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:16.258808 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f62def66-1232-4839-be57-f61c892e52ae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:16.382062 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f62def66-1232-4839-be57-f61c892e52ae tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 23803 microversion: 2.20 time: 0.158695 Dec 14 10:16:16.383139 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 468/987] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:16 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 23803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:16:16.654026 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-da4a6869-2521-471b-ba7b-0030f27ef8e8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:16.654868 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-da4a6869-2521-471b-ba7b-0030f27ef8e8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:16.686216 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-da4a6869-2521-471b-ba7b-0030f27ef8e8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:16.686671 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-da4a6869-2521-471b-ba7b-0030f27ef8e8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:16.688126 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-da4a6869-2521-471b-ba7b-0030f27ef8e8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:16.688925 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-da4a6869-2521-471b-ba7b-0030f27ef8e8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:16.841336 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-da4a6869-2521-471b-ba7b-0030f27ef8e8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:16.850820 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-da4a6869-2521-471b-ba7b-0030f27ef8e8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1382 microversion: 2.1 time: 0.200936 Dec 14 10:16:16.851490 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 520/988] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:16 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1382 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:16.904353 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-1aa021be-e32d-45cf-b752-57a5b76ab3b1 req-ff299d69-27c5-41aa-a40a-c016afba79fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731c99da-4633-4de9-9678-02e9fecda7b4", "name": "network-vif-deleted", "tag": "eb309f74-48d9-4eb5-98e8-7571414fa330"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:16.909435 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:16:16.909435 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:16:16.930891 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-1aa021be-e32d-45cf-b752-57a5b76ab3b1 req-ff299d69-27c5-41aa-a40a-c016afba79fa service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:16.931263 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-1aa021be-e32d-45cf-b752-57a5b76ab3b1 req-ff299d69-27c5-41aa-a40a-c016afba79fa service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:16.949172 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-1aa021be-e32d-45cf-b752-57a5b76ab3b1 req-ff299d69-27c5-41aa-a40a-c016afba79fa service nova] Creating event network-vif-deleted:eb309f74-48d9-4eb5-98e8-7571414fa330 for instance 731c99da-4633-4de9-9678-02e9fecda7b4 on hv-cinder-81888 Dec 14 10:16:16.954562 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-1aa021be-e32d-45cf-b752-57a5b76ab3b1 req-ff299d69-27c5-41aa-a40a-c016afba79fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055451 Dec 14 10:16:16.955688 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 469/989] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:16:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:16:17.395521 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c1742fe5-aa64-486b-bd4d-31767320bc1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:17.396701 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c1742fe5-aa64-486b-bd4d-31767320bc1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:17.406997 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c1742fe5-aa64-486b-bd4d-31767320bc1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:17.408211 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c1742fe5-aa64-486b-bd4d-31767320bc1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:17.409059 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c1742fe5-aa64-486b-bd4d-31767320bc1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:17.409505 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c1742fe5-aa64-486b-bd4d-31767320bc1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:17.541214 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c1742fe5-aa64-486b-bd4d-31767320bc1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 25538 microversion: 2.20 time: 0.150647 Dec 14 10:16:17.542140 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 521/990] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:17 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 25538 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:16:17.868285 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-48053634-58dc-455c-a3b9-abf592e872a8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:17.869082 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-48053634-58dc-455c-a3b9-abf592e872a8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:17.877131 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-48053634-58dc-455c-a3b9-abf592e872a8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:17.877662 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-48053634-58dc-455c-a3b9-abf592e872a8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:17.878560 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-48053634-58dc-455c-a3b9-abf592e872a8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:17.879062 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-48053634-58dc-455c-a3b9-abf592e872a8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:17.962319 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-48053634-58dc-455c-a3b9-abf592e872a8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:17.963020 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-48053634-58dc-455c-a3b9-abf592e872a8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:17.963436 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.objects.instance [None req-48053634-58dc-455c-a3b9-abf592e872a8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lazy-loading 'fault' on Instance uuid 731c99da-4633-4de9-9678-02e9fecda7b4 {{(pid=100985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:16:18.041915 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-48053634-58dc-455c-a3b9-abf592e872a8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '235d3d850d9e4d90bb29d5f891e23419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a588cde51b9d45b2844c4ffc951dac41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:18.049809 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-48053634-58dc-455c-a3b9-abf592e872a8 tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 200 len: 1178 microversion: 2.1 time: 0.185612 Dec 14 10:16:18.057234 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 470/991] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:17 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 1178 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:18.554810 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5d5d5f7e-d7bd-4d72-84fb-84540a83079b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:18.555893 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5d5d5f7e-d7bd-4d72-84fb-84540a83079b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:18.564411 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5d5d5f7e-d7bd-4d72-84fb-84540a83079b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:18.564923 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5d5d5f7e-d7bd-4d72-84fb-84540a83079b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:18.565758 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5d5d5f7e-d7bd-4d72-84fb-84540a83079b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:18.566473 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5d5d5f7e-d7bd-4d72-84fb-84540a83079b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:18.683269 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5d5d5f7e-d7bd-4d72-84fb-84540a83079b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 26962 microversion: 2.20 time: 0.133160 Dec 14 10:16:18.685992 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 522/992] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:18 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 26962 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:16:19.067249 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e6ec6a05-6dd5-4cb5-b9fa-3702fde8057a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:19.068696 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e6ec6a05-6dd5-4cb5-b9fa-3702fde8057a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] [instance: 731c99da-4633-4de9-9678-02e9fecda7b4] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:19.079352 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e6ec6a05-6dd5-4cb5-b9fa-3702fde8057a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:19.079793 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e6ec6a05-6dd5-4cb5-b9fa-3702fde8057a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:19.080584 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e6ec6a05-6dd5-4cb5-b9fa-3702fde8057a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:19.081108 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e6ec6a05-6dd5-4cb5-b9fa-3702fde8057a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:19.139752 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-e6ec6a05-6dd5-4cb5-b9fa-3702fde8057a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] HTTP exception thrown: Instance 731c99da-4633-4de9-9678-02e9fecda7b4 could not be found. Dec 14 10:16:19.140992 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e6ec6a05-6dd5-4cb5-b9fa-3702fde8057a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Returning 404 to user: Instance 731c99da-4633-4de9-9678-02e9fecda7b4 could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:16:19.141810 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e6ec6a05-6dd5-4cb5-b9fa-3702fde8057a tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4" status: 404 len: 111 microversion: 2.1 time: 0.078403 Dec 14 10:16:19.142579 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 471/993] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:19 2021] GET /compute/v2.1/servers/731c99da-4633-4de9-9678-02e9fecda7b4 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:16:19.372538 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-220cf090-e36e-422f-9a4d-ad38424c80be tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] Calling method '.version_select at 0x7fb17aeadd30>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:19.392495 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-220cf090-e36e-422f-9a4d-ad38424c80be tempest-TestShelveInstance-122978389 tempest-TestShelveInstance-122978389-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2076031675" status: 202 len: 0 microversion: 2.1 time: 0.025039 Dec 14 10:16:19.393061 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 523/994] 10.222.0.20 () {58 vars in 1253 bytes} [Tue Dec 14 10:16:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2076031675 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:16:19.695764 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-4a389304-d1e1-4fbf-8efd-33b1b11861b5 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:19.696735 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-4a389304-d1e1-4fbf-8efd-33b1b11861b5 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:19.703814 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4a389304-d1e1-4fbf-8efd-33b1b11861b5 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:19.704268 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4a389304-d1e1-4fbf-8efd-33b1b11861b5 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:19.705040 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4a389304-d1e1-4fbf-8efd-33b1b11861b5 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:19.705487 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4a389304-d1e1-4fbf-8efd-33b1b11861b5 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:19.820856 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-4a389304-d1e1-4fbf-8efd-33b1b11861b5 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 27654 microversion: 2.20 time: 0.128659 Dec 14 10:16:19.824704 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 472/995] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:19 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 27654 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:16:20.834974 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-3b2a9c53-8bb6-423e-b52a-d0167218cfcf tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:20.836716 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-3b2a9c53-8bb6-423e-b52a-d0167218cfcf tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:20.846135 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3b2a9c53-8bb6-423e-b52a-d0167218cfcf tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:20.846578 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3b2a9c53-8bb6-423e-b52a-d0167218cfcf tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:20.847358 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3b2a9c53-8bb6-423e-b52a-d0167218cfcf tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:20.847789 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3b2a9c53-8bb6-423e-b52a-d0167218cfcf tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:20.957187 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-3b2a9c53-8bb6-423e-b52a-d0167218cfcf tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 28122 microversion: 2.20 time: 0.127416 Dec 14 10:16:20.961071 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 524/996] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:20 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 28122 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:16:21.858344 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-bad40d10-7067-49f3-87e1-9d6c33412289 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:21.859153 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-bad40d10-7067-49f3-87e1-9d6c33412289 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:21.866825 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bad40d10-7067-49f3-87e1-9d6c33412289 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:21.867264 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bad40d10-7067-49f3-87e1-9d6c33412289 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:21.868169 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bad40d10-7067-49f3-87e1-9d6c33412289 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:21.868676 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-bad40d10-7067-49f3-87e1-9d6c33412289 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:21.932146 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-bad40d10-7067-49f3-87e1-9d6c33412289 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Going to try to terminate instance {{(pid=100985) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:16:21.969551 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-60734455-2b4c-4781-9341-aa0cf020db0b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:21.970945 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-60734455-2b4c-4781-9341-aa0cf020db0b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:21.978919 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-60734455-2b4c-4781-9341-aa0cf020db0b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:21.979367 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-60734455-2b4c-4781-9341-aa0cf020db0b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:21.980132 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-60734455-2b4c-4781-9341-aa0cf020db0b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:21.980814 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-60734455-2b4c-4781-9341-aa0cf020db0b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:22.089407 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-bad40d10-7067-49f3-87e1-9d6c33412289 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 204 len: 0 microversion: 2.1 time: 0.234276 Dec 14 10:16:22.093804 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 473/997] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:16:21 2021] DELETE /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 10:16:22.100625 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-907622ac-e8a8-4cf3-b542-45851308f1c9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:22.101322 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-907622ac-e8a8-4cf3-b542-45851308f1c9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:22.106953 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-60734455-2b4c-4781-9341-aa0cf020db0b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 28184 microversion: 2.20 time: 0.140675 Dec 14 10:16:22.108322 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 525/998] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:21 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 28184 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:16:22.110246 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-907622ac-e8a8-4cf3-b542-45851308f1c9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:22.110883 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-907622ac-e8a8-4cf3-b542-45851308f1c9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:22.112116 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-907622ac-e8a8-4cf3-b542-45851308f1c9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:22.112695 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-907622ac-e8a8-4cf3-b542-45851308f1c9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:22.629079 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-907622ac-e8a8-4cf3-b542-45851308f1c9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:22.644004 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-907622ac-e8a8-4cf3-b542-45851308f1c9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1577 microversion: 2.1 time: 0.548493 Dec 14 10:16:22.655254 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 474/999] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:22 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1577 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:23.120217 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-22cf6619-1ed4-4af1-997e-acc5bef9e466 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:23.121220 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-22cf6619-1ed4-4af1-997e-acc5bef9e466 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:23.129745 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-22cf6619-1ed4-4af1-997e-acc5bef9e466 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:23.130239 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-22cf6619-1ed4-4af1-997e-acc5bef9e466 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:23.131006 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-22cf6619-1ed4-4af1-997e-acc5bef9e466 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:23.131436 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-22cf6619-1ed4-4af1-997e-acc5bef9e466 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:23.247303 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-22cf6619-1ed4-4af1-997e-acc5bef9e466 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 28199 microversion: 2.20 time: 0.131128 Dec 14 10:16:23.247945 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 526/1000] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:23 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 28199 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:16:23.662606 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-7e4452bb-18ec-4ada-b16f-ce0e7fda2ff9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:23.663346 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-7e4452bb-18ec-4ada-b16f-ce0e7fda2ff9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:23.671922 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7e4452bb-18ec-4ada-b16f-ce0e7fda2ff9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:23.672533 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7e4452bb-18ec-4ada-b16f-ce0e7fda2ff9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:23.673374 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7e4452bb-18ec-4ada-b16f-ce0e7fda2ff9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:23.673879 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-7e4452bb-18ec-4ada-b16f-ce0e7fda2ff9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:24.223981 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-7e4452bb-18ec-4ada-b16f-ce0e7fda2ff9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:24.235150 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-7e4452bb-18ec-4ada-b16f-ce0e7fda2ff9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1577 microversion: 2.1 time: 0.576499 Dec 14 10:16:24.246701 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 475/1001] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:23 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1577 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:24.260795 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-aa380c1f-358e-4c67-8309-35561acdaad9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:24.262660 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-aa380c1f-358e-4c67-8309-35561acdaad9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:24.275079 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aa380c1f-358e-4c67-8309-35561acdaad9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:24.275908 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aa380c1f-358e-4c67-8309-35561acdaad9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:24.277190 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aa380c1f-358e-4c67-8309-35561acdaad9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:24.277838 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-aa380c1f-358e-4c67-8309-35561acdaad9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:24.398595 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-aa380c1f-358e-4c67-8309-35561acdaad9 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 28474 microversion: 2.20 time: 0.142501 Dec 14 10:16:24.399645 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 527/1002] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:24 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 28474 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 10:16:25.252776 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-fe4e66ba-6c38-47e2-87b6-ebfab39ddf32 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:25.253384 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-fe4e66ba-6c38-47e2-87b6-ebfab39ddf32 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:25.260886 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fe4e66ba-6c38-47e2-87b6-ebfab39ddf32 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:25.261368 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fe4e66ba-6c38-47e2-87b6-ebfab39ddf32 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:25.262278 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fe4e66ba-6c38-47e2-87b6-ebfab39ddf32 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:25.262739 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fe4e66ba-6c38-47e2-87b6-ebfab39ddf32 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:25.411464 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4bfc8d31-6092-4a82-9a9d-eee8e793c5ee tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:25.412527 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4bfc8d31-6092-4a82-9a9d-eee8e793c5ee tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:25.422893 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4bfc8d31-6092-4a82-9a9d-eee8e793c5ee tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:25.423838 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4bfc8d31-6092-4a82-9a9d-eee8e793c5ee tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:25.425012 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4bfc8d31-6092-4a82-9a9d-eee8e793c5ee tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:25.425663 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4bfc8d31-6092-4a82-9a9d-eee8e793c5ee tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:25.444778 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-fe4e66ba-6c38-47e2-87b6-ebfab39ddf32 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:25.458848 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-fe4e66ba-6c38-47e2-87b6-ebfab39ddf32 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1510 microversion: 2.1 time: 0.209709 Dec 14 10:16:25.470646 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 476/1003] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:25 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1510 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:25.554818 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4bfc8d31-6092-4a82-9a9d-eee8e793c5ee tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 28642 microversion: 2.20 time: 0.147420 Dec 14 10:16:25.556200 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 528/1004] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:25 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 28642 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 10:16:25.700601 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-53da9ee0-45ac-4cf3-9449-e409d5e4d9e6 req-a7d5b5ab-bafd-4f8d-a2fa-51f37261a3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6", "name": "network-vif-deleted", "tag": "5a76754a-00ff-4c50-83e7-bc0e420e7c19"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:25.703307 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:16:25.703307 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:16:25.712934 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-53da9ee0-45ac-4cf3-9449-e409d5e4d9e6 req-a7d5b5ab-bafd-4f8d-a2fa-51f37261a3e3 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:25.713777 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-53da9ee0-45ac-4cf3-9449-e409d5e4d9e6 req-a7d5b5ab-bafd-4f8d-a2fa-51f37261a3e3 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:25.752175 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-53da9ee0-45ac-4cf3-9449-e409d5e4d9e6 req-a7d5b5ab-bafd-4f8d-a2fa-51f37261a3e3 service nova] Creating event network-vif-deleted:5a76754a-00ff-4c50-83e7-bc0e420e7c19 for instance fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 on hv-cinder-81888 Dec 14 10:16:25.757055 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-53da9ee0-45ac-4cf3-9449-e409d5e4d9e6 req-a7d5b5ab-bafd-4f8d-a2fa-51f37261a3e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060445 Dec 14 10:16:25.757639 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 477/1005] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:16:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:16:26.477125 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-cb906eef-8a34-4ba0-a4ae-1a557c298e55 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:26.478521 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-cb906eef-8a34-4ba0-a4ae-1a557c298e55 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:26.487436 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cb906eef-8a34-4ba0-a4ae-1a557c298e55 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:26.487968 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cb906eef-8a34-4ba0-a4ae-1a557c298e55 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:26.488798 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cb906eef-8a34-4ba0-a4ae-1a557c298e55 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:26.489297 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cb906eef-8a34-4ba0-a4ae-1a557c298e55 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:26.567780 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3250a12a-13e6-4e98-81bc-43698ee0c8aa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:26.568776 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3250a12a-13e6-4e98-81bc-43698ee0c8aa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:26.584553 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3250a12a-13e6-4e98-81bc-43698ee0c8aa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:26.586629 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3250a12a-13e6-4e98-81bc-43698ee0c8aa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:26.586996 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cb906eef-8a34-4ba0-a4ae-1a557c298e55 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:26.587779 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cb906eef-8a34-4ba0-a4ae-1a557c298e55 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:26.589018 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.objects.instance [None req-cb906eef-8a34-4ba0-a4ae-1a557c298e55 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lazy-loading 'fault' on Instance uuid fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 {{(pid=100984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:16:26.589765 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3250a12a-13e6-4e98-81bc-43698ee0c8aa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:26.591410 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3250a12a-13e6-4e98-81bc-43698ee0c8aa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:26.674029 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-cb906eef-8a34-4ba0-a4ae-1a557c298e55 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:26.685153 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-cb906eef-8a34-4ba0-a4ae-1a557c298e55 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 200 len: 1230 microversion: 2.1 time: 0.212214 Dec 14 10:16:26.687841 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 529/1006] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:26 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 1230 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:26.744218 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3250a12a-13e6-4e98-81bc-43698ee0c8aa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 28642 microversion: 2.20 time: 0.180676 Dec 14 10:16:26.745362 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 478/1007] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:26 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 28642 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 10:16:27.703665 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-ec67938e-c214-4159-8607-5928f7be0fa6 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:27.704280 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-ec67938e-c214-4159-8607-5928f7be0fa6 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:27.711850 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ec67938e-c214-4159-8607-5928f7be0fa6 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:27.712301 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ec67938e-c214-4159-8607-5928f7be0fa6 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:27.713075 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ec67938e-c214-4159-8607-5928f7be0fa6 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:27.713507 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ec67938e-c214-4159-8607-5928f7be0fa6 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:27.758275 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b0c0848c-30de-43f0-8ac2-6ce4b6889e2f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:27.760339 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-b0c0848c-30de-43f0-8ac2-6ce4b6889e2f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:27.768333 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-ec67938e-c214-4159-8607-5928f7be0fa6 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] HTTP exception thrown: Instance fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 could not be found. Dec 14 10:16:27.768933 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-ec67938e-c214-4159-8607-5928f7be0fa6 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Returning 404 to user: Instance fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:16:27.769755 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-ec67938e-c214-4159-8607-5928f7be0fa6 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 404 len: 111 microversion: 2.1 time: 0.070875 Dec 14 10:16:27.770058 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b0c0848c-30de-43f0-8ac2-6ce4b6889e2f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:27.770568 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 530/1008] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:27 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:16:27.770696 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b0c0848c-30de-43f0-8ac2-6ce4b6889e2f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:27.771545 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b0c0848c-30de-43f0-8ac2-6ce4b6889e2f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:27.772098 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b0c0848c-30de-43f0-8ac2-6ce4b6889e2f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:27.873891 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-b0c0848c-30de-43f0-8ac2-6ce4b6889e2f tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 28642 microversion: 2.20 time: 0.120639 Dec 14 10:16:27.875365 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 479/1009] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:27 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 28642 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:16:27.881802 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4563049a-4ce3-48db-807e-08e25c0eaf59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1871848274", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-621328310", "security_groups": [{"name": "tempest-secgroup-smoke-442028405"}], "block_device_mapping_v2": [{"uuid": "1a1784b6-5677-4265-a537-de8f08aa7a18", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bd1cbab0-8707-4ef3-99d9-9624dbe62aa4"}]}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:28.053365 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.network.neutron [None req-4563049a-4ce3-48db-807e-08e25c0eaf59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] validate_networks() for [('bd1cbab0-8707-4ef3-99d9-9624dbe62aa4', None, None, None)] {{(pid=100984) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:16:28.775582 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-4563049a-4ce3-48db-807e-08e25c0eaf59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Flavor limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:16:28.776438 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-4563049a-4ce3-48db-807e-08e25c0eaf59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Image limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:16:28.776894 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-4563049a-4ce3-48db-807e-08e25c0eaf59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Flavor pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:16:28.777290 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-4563049a-4ce3-48db-807e-08e25c0eaf59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Image pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:16:28.777901 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-4563049a-4ce3-48db-807e-08e25c0eaf59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:16:28.792218 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4563049a-4ce3-48db-807e-08e25c0eaf59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:28.792830 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4563049a-4ce3-48db-807e-08e25c0eaf59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:28.793810 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4563049a-4ce3-48db-807e-08e25c0eaf59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:28.794422 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4563049a-4ce3-48db-807e-08e25c0eaf59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:28.813474 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-4563049a-4ce3-48db-807e-08e25c0eaf59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Getting quotas for project 1381b4c2d5654dc2bf924671ef0ec4a3. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:16:28.817470 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-4563049a-4ce3-48db-807e-08e25c0eaf59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Getting quotas for user e9766e50607147dbad279b733d671264 and project 1381b4c2d5654dc2bf924671ef0ec4a3. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:16:28.895900 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b2522d86-8b43-4623-9de4-130281983573 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:28.897129 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-b2522d86-8b43-4623-9de4-130281983573 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:28.907105 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b2522d86-8b43-4623-9de4-130281983573 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:28.907906 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b2522d86-8b43-4623-9de4-130281983573 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:28.909188 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b2522d86-8b43-4623-9de4-130281983573 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:28.909844 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b2522d86-8b43-4623-9de4-130281983573 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:28.911622 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4563049a-4ce3-48db-807e-08e25c0eaf59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Going to run 1 instances... {{(pid=100984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:16:28.913713 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4563049a-4ce3-48db-807e-08e25c0eaf59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1a1784b6-5677-4265-a537-de8f08aa7a18',volume_size=None,volume_type=None)] {{(pid=100984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:16:29.047486 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-b2522d86-8b43-4623-9de4-130281983573 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 28761 microversion: 2.20 time: 0.163878 Dec 14 10:16:29.048382 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 480/1010] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:28 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 28761 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 10:16:29.134929 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4563049a-4ce3-48db-807e-08e25c0eaf59 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.256480 Dec 14 10:16:29.138008 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 531/1011] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Dec 14 10:16:27 2021] POST /compute/v2.1/servers => generated 405 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 14 10:16:29.148869 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-7f3b0c87-8e25-4633-a05a-8c3f826dd025 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:29.150611 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-7f3b0c87-8e25-4633-a05a-8c3f826dd025 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:29.275671 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-7f3b0c87-8e25-4633-a05a-8c3f826dd025 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:29.284902 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-7f3b0c87-8e25-4633-a05a-8c3f826dd025 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1094 microversion: 2.1 time: 0.139976 Dec 14 10:16:29.294561 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 481/1012] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:29 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1094 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:30.060827 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-bf7e31fd-52a2-4138-b32a-f91d1e6cec66 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:30.063261 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-bf7e31fd-52a2-4138-b32a-f91d1e6cec66 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:30.073232 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bf7e31fd-52a2-4138-b32a-f91d1e6cec66 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:30.073676 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bf7e31fd-52a2-4138-b32a-f91d1e6cec66 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:30.074795 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bf7e31fd-52a2-4138-b32a-f91d1e6cec66 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:30.075395 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bf7e31fd-52a2-4138-b32a-f91d1e6cec66 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:30.221781 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-bf7e31fd-52a2-4138-b32a-f91d1e6cec66 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 30493 microversion: 2.20 time: 0.166197 Dec 14 10:16:30.222493 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 532/1013] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:30 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 30493 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:16:30.309157 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-29aa0ec2-8201-4b01-af78-ffd04baafc4f tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:30.309811 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-29aa0ec2-8201-4b01-af78-ffd04baafc4f tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:30.330892 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-29aa0ec2-8201-4b01-af78-ffd04baafc4f tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:30.331334 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-29aa0ec2-8201-4b01-af78-ffd04baafc4f tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:30.332119 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-29aa0ec2-8201-4b01-af78-ffd04baafc4f tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:30.332914 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-29aa0ec2-8201-4b01-af78-ffd04baafc4f tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:30.501359 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-29aa0ec2-8201-4b01-af78-ffd04baafc4f tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:30.509602 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-29aa0ec2-8201-4b01-af78-ffd04baafc4f tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1200 microversion: 2.1 time: 0.210646 Dec 14 10:16:30.510397 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 482/1014] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:30 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1200 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:31.234900 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-73577343-e9d1-471a-a56c-ebdbc8d7f8b8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:31.236958 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-73577343-e9d1-471a-a56c-ebdbc8d7f8b8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:31.248871 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73577343-e9d1-471a-a56c-ebdbc8d7f8b8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:31.250300 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73577343-e9d1-471a-a56c-ebdbc8d7f8b8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:31.251992 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73577343-e9d1-471a-a56c-ebdbc8d7f8b8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:31.252632 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-73577343-e9d1-471a-a56c-ebdbc8d7f8b8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:31.377252 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-73577343-e9d1-471a-a56c-ebdbc8d7f8b8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 32259 microversion: 2.20 time: 0.139357 Dec 14 10:16:31.384741 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 533/1015] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:31 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 32259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:16:31.527485 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-0929d2db-3e49-446f-9d0a-103a5f7a0758 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:31.528818 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-0929d2db-3e49-446f-9d0a-103a5f7a0758 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:31.540067 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0929d2db-3e49-446f-9d0a-103a5f7a0758 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:31.540890 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0929d2db-3e49-446f-9d0a-103a5f7a0758 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:31.542079 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0929d2db-3e49-446f-9d0a-103a5f7a0758 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:31.542925 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0929d2db-3e49-446f-9d0a-103a5f7a0758 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:32.072973 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-0929d2db-3e49-446f-9d0a-103a5f7a0758 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:32.081710 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-0929d2db-3e49-446f-9d0a-103a5f7a0758 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1277 microversion: 2.1 time: 0.558239 Dec 14 10:16:32.082528 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 483/1016] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:31 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1277 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:32.389185 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d0d3e1a0-b1f1-4a7e-a94d-55eef833ce33 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:32.390233 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d0d3e1a0-b1f1-4a7e-a94d-55eef833ce33 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:32.398747 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d0d3e1a0-b1f1-4a7e-a94d-55eef833ce33 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:32.399443 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d0d3e1a0-b1f1-4a7e-a94d-55eef833ce33 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:32.400406 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d0d3e1a0-b1f1-4a7e-a94d-55eef833ce33 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:32.401005 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d0d3e1a0-b1f1-4a7e-a94d-55eef833ce33 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:32.523882 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d0d3e1a0-b1f1-4a7e-a94d-55eef833ce33 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 33281 microversion: 2.20 time: 0.138584 Dec 14 10:16:32.526582 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 534/1017] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:32 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 33281 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:16:32.799538 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-0bc15b80-d4ca-4291-ab49-799a2fa2326f req-7a48e0e2-8184-4eb2-b0f2-62eea44081e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c457d9c4-d3ef-4ae8-a78c-eb75762205aa", "tag": "4c4fd8bf-4fbe-4f99-a91b-0b9bd1365298"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:32.801794 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:16:32.801794 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:16:32.827986 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-0bc15b80-d4ca-4291-ab49-799a2fa2326f req-7a48e0e2-8184-4eb2-b0f2-62eea44081e5 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:32.828274 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-0bc15b80-d4ca-4291-ab49-799a2fa2326f req-7a48e0e2-8184-4eb2-b0f2-62eea44081e5 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:32.871011 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-0bc15b80-d4ca-4291-ab49-799a2fa2326f req-7a48e0e2-8184-4eb2-b0f2-62eea44081e5 service nova] Creating event network-changed:4c4fd8bf-4fbe-4f99-a91b-0b9bd1365298 for instance c457d9c4-d3ef-4ae8-a78c-eb75762205aa on hv-cinder-81888 Dec 14 10:16:32.876606 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-0bc15b80-d4ca-4291-ab49-799a2fa2326f req-7a48e0e2-8184-4eb2-b0f2-62eea44081e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086910 Dec 14 10:16:32.877518 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 484/1018] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:16:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:16:33.099831 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d62db674-b0ec-4da7-981a-25e908a4afc2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:33.100724 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d62db674-b0ec-4da7-981a-25e908a4afc2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:33.109584 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d62db674-b0ec-4da7-981a-25e908a4afc2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:33.110283 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d62db674-b0ec-4da7-981a-25e908a4afc2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:33.111202 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d62db674-b0ec-4da7-981a-25e908a4afc2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:33.111987 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d62db674-b0ec-4da7-981a-25e908a4afc2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:33.322711 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d62db674-b0ec-4da7-981a-25e908a4afc2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:33.331403 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d62db674-b0ec-4da7-981a-25e908a4afc2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1265 microversion: 2.1 time: 0.235888 Dec 14 10:16:33.331967 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 535/1019] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:33 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:33.538034 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-07ab7e8a-6105-45e2-ad8a-4920f7e6d5a3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:33.539284 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-07ab7e8a-6105-45e2-ad8a-4920f7e6d5a3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:33.547151 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-07ab7e8a-6105-45e2-ad8a-4920f7e6d5a3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:33.547593 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-07ab7e8a-6105-45e2-ad8a-4920f7e6d5a3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:33.549417 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-07ab7e8a-6105-45e2-ad8a-4920f7e6d5a3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:33.549853 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-07ab7e8a-6105-45e2-ad8a-4920f7e6d5a3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:33.665988 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-07ab7e8a-6105-45e2-ad8a-4920f7e6d5a3 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 34120 microversion: 2.20 time: 0.132039 Dec 14 10:16:33.669998 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 485/1020] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:33 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 34120 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:16:34.348068 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-175e551e-d2fd-4381-82ca-1188bb046580 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:34.348657 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-175e551e-d2fd-4381-82ca-1188bb046580 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:34.356146 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-175e551e-d2fd-4381-82ca-1188bb046580 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:34.356580 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-175e551e-d2fd-4381-82ca-1188bb046580 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:34.357328 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-175e551e-d2fd-4381-82ca-1188bb046580 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:34.357747 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-175e551e-d2fd-4381-82ca-1188bb046580 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:34.553856 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-175e551e-d2fd-4381-82ca-1188bb046580 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:34.561936 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-175e551e-d2fd-4381-82ca-1188bb046580 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1265 microversion: 2.1 time: 0.217402 Dec 14 10:16:34.562512 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 536/1021] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:34 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:34.678171 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b485eff6-9ae7-4a54-824d-989d6e0f715e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:34.679172 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-b485eff6-9ae7-4a54-824d-989d6e0f715e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:34.687434 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b485eff6-9ae7-4a54-824d-989d6e0f715e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:34.687879 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b485eff6-9ae7-4a54-824d-989d6e0f715e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:34.688642 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b485eff6-9ae7-4a54-824d-989d6e0f715e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:34.689083 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b485eff6-9ae7-4a54-824d-989d6e0f715e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:34.799434 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-b485eff6-9ae7-4a54-824d-989d6e0f715e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 35212 microversion: 2.20 time: 0.125144 Dec 14 10:16:34.800173 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 486/1022] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:34 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 35212 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:16:35.577525 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8626ee32-7233-48e7-aefa-e4866151290b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:35.578241 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-8626ee32-7233-48e7-aefa-e4866151290b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:35.585355 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8626ee32-7233-48e7-aefa-e4866151290b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:35.585792 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8626ee32-7233-48e7-aefa-e4866151290b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:35.586569 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8626ee32-7233-48e7-aefa-e4866151290b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:35.586991 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8626ee32-7233-48e7-aefa-e4866151290b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:35.783788 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-8626ee32-7233-48e7-aefa-e4866151290b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:35.791830 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8626ee32-7233-48e7-aefa-e4866151290b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1265 microversion: 2.1 time: 0.217927 Dec 14 10:16:35.792390 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 537/1023] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:35 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:35.812589 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-03fe8483-fc0f-42f4-9c24-21c49b38bb1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:35.813615 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-03fe8483-fc0f-42f4-9c24-21c49b38bb1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:35.821316 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-03fe8483-fc0f-42f4-9c24-21c49b38bb1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:35.821754 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-03fe8483-fc0f-42f4-9c24-21c49b38bb1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:35.822558 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-03fe8483-fc0f-42f4-9c24-21c49b38bb1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:35.822982 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-03fe8483-fc0f-42f4-9c24-21c49b38bb1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:35.926150 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-03fe8483-fc0f-42f4-9c24-21c49b38bb1c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 36854 microversion: 2.20 time: 0.117617 Dec 14 10:16:35.927150 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 487/1024] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:35 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 36854 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:16:36.808414 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8a04ff54-8443-4e64-9f61-11425d1618b0 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:36.809048 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-8a04ff54-8443-4e64-9f61-11425d1618b0 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:36.817180 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8a04ff54-8443-4e64-9f61-11425d1618b0 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:36.817617 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8a04ff54-8443-4e64-9f61-11425d1618b0 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:36.818408 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8a04ff54-8443-4e64-9f61-11425d1618b0 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:36.818837 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8a04ff54-8443-4e64-9f61-11425d1618b0 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:36.939135 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3c97aa7a-7f07-495f-b196-bad47e44a584 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:36.940734 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3c97aa7a-7f07-495f-b196-bad47e44a584 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:36.948627 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3c97aa7a-7f07-495f-b196-bad47e44a584 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:36.949074 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3c97aa7a-7f07-495f-b196-bad47e44a584 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:36.949838 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3c97aa7a-7f07-495f-b196-bad47e44a584 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:36.950292 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3c97aa7a-7f07-495f-b196-bad47e44a584 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:37.016954 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-8a04ff54-8443-4e64-9f61-11425d1618b0 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:37.025033 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8a04ff54-8443-4e64-9f61-11425d1618b0 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1265 microversion: 2.1 time: 0.220335 Dec 14 10:16:37.025583 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 538/1025] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:36 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:37.051729 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3c97aa7a-7f07-495f-b196-bad47e44a584 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 38196 microversion: 2.20 time: 0.117240 Dec 14 10:16:37.056172 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 488/1026] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:36 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 38196 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 10:16:38.042016 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-764c8885-da65-49af-96c5-d09237f7d7a5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:38.042551 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-764c8885-da65-49af-96c5-d09237f7d7a5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:38.050351 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-764c8885-da65-49af-96c5-d09237f7d7a5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:38.050794 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-764c8885-da65-49af-96c5-d09237f7d7a5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:38.051557 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-764c8885-da65-49af-96c5-d09237f7d7a5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:38.051991 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-764c8885-da65-49af-96c5-d09237f7d7a5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:38.064968 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-cae6315d-77b5-4d82-b097-10b984f2b1d6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:38.066083 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-cae6315d-77b5-4d82-b097-10b984f2b1d6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:38.074027 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cae6315d-77b5-4d82-b097-10b984f2b1d6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:38.074582 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cae6315d-77b5-4d82-b097-10b984f2b1d6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:38.075435 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cae6315d-77b5-4d82-b097-10b984f2b1d6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:38.075944 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cae6315d-77b5-4d82-b097-10b984f2b1d6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:38.172537 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-cae6315d-77b5-4d82-b097-10b984f2b1d6 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 38196 microversion: 2.20 time: 0.112245 Dec 14 10:16:38.176770 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 489/1027] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:38 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 38196 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 10:16:38.251449 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-764c8885-da65-49af-96c5-d09237f7d7a5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:38.259469 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-764c8885-da65-49af-96c5-d09237f7d7a5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1265 microversion: 2.1 time: 0.221303 Dec 14 10:16:38.260018 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 539/1028] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:38 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:39.185071 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-11a6fcde-cd79-4486-8788-4f54bf7b525e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:39.186080 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-11a6fcde-cd79-4486-8788-4f54bf7b525e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:39.194353 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-11a6fcde-cd79-4486-8788-4f54bf7b525e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:39.194794 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-11a6fcde-cd79-4486-8788-4f54bf7b525e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:39.195549 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-11a6fcde-cd79-4486-8788-4f54bf7b525e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:39.195979 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-11a6fcde-cd79-4486-8788-4f54bf7b525e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:39.276626 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f8764afd-90ca-41b7-9334-87ece67a9e4f tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:39.277263 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f8764afd-90ca-41b7-9334-87ece67a9e4f tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:39.285149 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f8764afd-90ca-41b7-9334-87ece67a9e4f tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:39.285608 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f8764afd-90ca-41b7-9334-87ece67a9e4f tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:39.286479 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f8764afd-90ca-41b7-9334-87ece67a9e4f tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:39.286960 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f8764afd-90ca-41b7-9334-87ece67a9e4f tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:39.287239 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-11a6fcde-cd79-4486-8788-4f54bf7b525e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 38196 microversion: 2.20 time: 0.106158 Dec 14 10:16:39.291451 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 490/1029] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:39 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 38196 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 10:16:39.484521 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-f8764afd-90ca-41b7-9334-87ece67a9e4f tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:39.492681 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f8764afd-90ca-41b7-9334-87ece67a9e4f tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1265 microversion: 2.1 time: 0.219998 Dec 14 10:16:39.493239 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 540/1030] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:39 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:16:40.299774 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-056dbed2-2c82-40a1-b3e6-6d0a0a8d8c88 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:40.300656 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-056dbed2-2c82-40a1-b3e6-6d0a0a8d8c88 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:40.308460 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-056dbed2-2c82-40a1-b3e6-6d0a0a8d8c88 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:40.308902 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-056dbed2-2c82-40a1-b3e6-6d0a0a8d8c88 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:40.309656 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-056dbed2-2c82-40a1-b3e6-6d0a0a8d8c88 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:40.310114 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-056dbed2-2c82-40a1-b3e6-6d0a0a8d8c88 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:40.400730 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-056dbed2-2c82-40a1-b3e6-6d0a0a8d8c88 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 38196 microversion: 2.20 time: 0.105080 Dec 14 10:16:40.401603 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 491/1031] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:40 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 38196 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 14 10:16:40.509658 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-0fb4e53c-927d-4393-a700-434bd30c4aca tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:40.510301 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-0fb4e53c-927d-4393-a700-434bd30c4aca tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:40.518237 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0fb4e53c-927d-4393-a700-434bd30c4aca tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:40.518677 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0fb4e53c-927d-4393-a700-434bd30c4aca tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:40.519431 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0fb4e53c-927d-4393-a700-434bd30c4aca tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:40.519857 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0fb4e53c-927d-4393-a700-434bd30c4aca tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:40.712624 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-0fb4e53c-927d-4393-a700-434bd30c4aca tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:40.720700 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-0fb4e53c-927d-4393-a700-434bd30c4aca tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1265 microversion: 2.1 time: 0.214651 Dec 14 10:16:40.721264 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 541/1032] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:40 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:41.413583 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3662dcde-0b35-4782-95a7-643562510df4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:41.414538 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3662dcde-0b35-4782-95a7-643562510df4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:41.422906 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3662dcde-0b35-4782-95a7-643562510df4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:41.423348 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3662dcde-0b35-4782-95a7-643562510df4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:41.424103 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3662dcde-0b35-4782-95a7-643562510df4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:41.424531 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3662dcde-0b35-4782-95a7-643562510df4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:41.526916 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3662dcde-0b35-4782-95a7-643562510df4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 200 len: 38337 microversion: 2.20 time: 0.117121 Dec 14 10:16:41.527785 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 492/1033] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:41 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 38337 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:16:41.537911 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-ff180917-9841-416d-9132-0f5f4eac46ab tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:41.538439 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-ff180917-9841-416d-9132-0f5f4eac46ab tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:41.545974 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ff180917-9841-416d-9132-0f5f4eac46ab tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:41.546477 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ff180917-9841-416d-9132-0f5f4eac46ab tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:41.547784 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ff180917-9841-416d-9132-0f5f4eac46ab tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:41.548218 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ff180917-9841-416d-9132-0f5f4eac46ab tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:41.602906 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-ff180917-9841-416d-9132-0f5f4eac46ab tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/ips" status: 200 len: 151 microversion: 2.20 time: 0.068599 Dec 14 10:16:41.603469 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 542/1034] 10.222.0.20 () {60 vars in 1288 bytes} [Tue Dec 14 10:16:41 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/ips => generated 151 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:16:41.739042 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f1ad7092-d1f1-456a-982d-c3e9972bd67b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:41.739744 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f1ad7092-d1f1-456a-982d-c3e9972bd67b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:41.747394 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f1ad7092-d1f1-456a-982d-c3e9972bd67b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:41.747847 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f1ad7092-d1f1-456a-982d-c3e9972bd67b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:41.748617 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f1ad7092-d1f1-456a-982d-c3e9972bd67b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:41.749053 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f1ad7092-d1f1-456a-982d-c3e9972bd67b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:41.955931 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f1ad7092-d1f1-456a-982d-c3e9972bd67b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:41.964339 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f1ad7092-d1f1-456a-982d-c3e9972bd67b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1265 microversion: 2.1 time: 0.230430 Dec 14 10:16:41.973333 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 493/1035] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:41 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:42.981027 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-27604a8e-a4a3-4c4a-a926-b9b1f16ebbc6 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:42.981623 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-27604a8e-a4a3-4c4a-a926-b9b1f16ebbc6 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:42.988883 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-27604a8e-a4a3-4c4a-a926-b9b1f16ebbc6 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:42.989328 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-27604a8e-a4a3-4c4a-a926-b9b1f16ebbc6 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:42.990115 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-27604a8e-a4a3-4c4a-a926-b9b1f16ebbc6 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:42.990547 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-27604a8e-a4a3-4c4a-a926-b9b1f16ebbc6 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:43.188377 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-27604a8e-a4a3-4c4a-a926-b9b1f16ebbc6 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:43.196361 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-27604a8e-a4a3-4c4a-a926-b9b1f16ebbc6 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1265 microversion: 2.1 time: 0.219851 Dec 14 10:16:43.196916 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 543/1036] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:42 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:44.214735 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-63271f1a-2762-4fc6-aebd-49e5b4187873 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:44.215370 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-63271f1a-2762-4fc6-aebd-49e5b4187873 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:44.223004 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-63271f1a-2762-4fc6-aebd-49e5b4187873 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:44.223449 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-63271f1a-2762-4fc6-aebd-49e5b4187873 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:44.224207 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-63271f1a-2762-4fc6-aebd-49e5b4187873 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:44.224634 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-63271f1a-2762-4fc6-aebd-49e5b4187873 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:44.417318 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-63271f1a-2762-4fc6-aebd-49e5b4187873 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:44.425900 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-63271f1a-2762-4fc6-aebd-49e5b4187873 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1265 microversion: 2.1 time: 0.214864 Dec 14 10:16:44.426488 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 494/1037] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:44 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:45.442449 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-2b491429-7476-44a7-8bfa-5844b0281df9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:45.443074 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-2b491429-7476-44a7-8bfa-5844b0281df9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:45.450683 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2b491429-7476-44a7-8bfa-5844b0281df9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:45.451122 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2b491429-7476-44a7-8bfa-5844b0281df9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:45.451867 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2b491429-7476-44a7-8bfa-5844b0281df9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:45.452292 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2b491429-7476-44a7-8bfa-5844b0281df9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:45.653298 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-2b491429-7476-44a7-8bfa-5844b0281df9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:45.662176 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-2b491429-7476-44a7-8bfa-5844b0281df9 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1265 microversion: 2.1 time: 0.223530 Dec 14 10:16:45.662737 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 544/1038] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:45 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:46.678297 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-0389ee5e-0bf3-44fb-9c8b-398730499ac2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:46.678902 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-0389ee5e-0bf3-44fb-9c8b-398730499ac2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:46.686369 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0389ee5e-0bf3-44fb-9c8b-398730499ac2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:46.687309 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0389ee5e-0bf3-44fb-9c8b-398730499ac2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:46.688076 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0389ee5e-0bf3-44fb-9c8b-398730499ac2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:46.688502 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0389ee5e-0bf3-44fb-9c8b-398730499ac2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:46.892503 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-0389ee5e-0bf3-44fb-9c8b-398730499ac2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:46.900571 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-0389ee5e-0bf3-44fb-9c8b-398730499ac2 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1265 microversion: 2.1 time: 0.225940 Dec 14 10:16:46.901136 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 495/1039] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:46 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:47.917525 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1211efda-ed9d-46f1-85f4-d832c1d98d7c tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:47.918219 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1211efda-ed9d-46f1-85f4-d832c1d98d7c tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:47.925424 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1211efda-ed9d-46f1-85f4-d832c1d98d7c tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:47.926002 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1211efda-ed9d-46f1-85f4-d832c1d98d7c tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:47.926867 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1211efda-ed9d-46f1-85f4-d832c1d98d7c tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:47.927458 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1211efda-ed9d-46f1-85f4-d832c1d98d7c tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:48.121221 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1211efda-ed9d-46f1-85f4-d832c1d98d7c tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:48.129878 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1211efda-ed9d-46f1-85f4-d832c1d98d7c tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1265 microversion: 2.1 time: 0.216048 Dec 14 10:16:48.130456 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 545/1040] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:47 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:48.232842 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e19e0773-0d3b-4758-b224-7fb3514f4bce tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:48.233394 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e19e0773-0d3b-4758-b224-7fb3514f4bce tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:48.240640 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e19e0773-0d3b-4758-b224-7fb3514f4bce tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:48.241080 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e19e0773-0d3b-4758-b224-7fb3514f4bce tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:48.241838 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e19e0773-0d3b-4758-b224-7fb3514f4bce tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:48.242291 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e19e0773-0d3b-4758-b224-7fb3514f4bce tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:48.297617 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.objects.instance [None req-e19e0773-0d3b-4758-b224-7fb3514f4bce tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lazy-loading 'flavor' on Instance uuid cc8d226a-4c08-4a07-94a7-f7c17c509a27 {{(pid=100985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:16:48.628188 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e19e0773-0d3b-4758-b224-7fb3514f4bce tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 202 len: 0 microversion: 2.20 time: 0.398825 Dec 14 10:16:48.628940 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 496/1041] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:16:48 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 14 10:16:48.636615 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-b20be3f4-dc68-4173-a32f-197560c1b816 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:48.637224 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-b20be3f4-dc68-4173-a32f-197560c1b816 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:48.645325 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b20be3f4-dc68-4173-a32f-197560c1b816 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:48.645843 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b20be3f4-dc68-4173-a32f-197560c1b816 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:48.646570 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b20be3f4-dc68-4173-a32f-197560c1b816 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:48.646999 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b20be3f4-dc68-4173-a32f-197560c1b816 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:48.850606 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-b20be3f4-dc68-4173-a32f-197560c1b816 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:48.859242 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-b20be3f4-dc68-4173-a32f-197560c1b816 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:48.860727 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-b20be3f4-dc68-4173-a32f-197560c1b816 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:48.861838 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-b20be3f4-dc68-4173-a32f-197560c1b816 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1723 microversion: 2.20 time: 0.229002 Dec 14 10:16:48.862410 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 546/1042] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:16:48 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:16:49.146804 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b77a043a-484e-4b10-bbc7-9bc8e80a0ba4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:49.147784 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-b77a043a-484e-4b10-bbc7-9bc8e80a0ba4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:49.155876 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b77a043a-484e-4b10-bbc7-9bc8e80a0ba4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:49.156297 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b77a043a-484e-4b10-bbc7-9bc8e80a0ba4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:49.157136 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b77a043a-484e-4b10-bbc7-9bc8e80a0ba4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:49.157658 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b77a043a-484e-4b10-bbc7-9bc8e80a0ba4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:49.355063 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-b77a043a-484e-4b10-bbc7-9bc8e80a0ba4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:49.364210 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-b77a043a-484e-4b10-bbc7-9bc8e80a0ba4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1265 microversion: 2.1 time: 0.221479 Dec 14 10:16:49.364782 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 497/1043] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:49 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:49.880160 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-86e6dc7c-c92a-43ad-845b-d8d560d639b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:49.880868 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-86e6dc7c-c92a-43ad-845b-d8d560d639b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:49.901075 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-86e6dc7c-c92a-43ad-845b-d8d560d639b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:49.901862 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-86e6dc7c-c92a-43ad-845b-d8d560d639b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:49.902722 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-86e6dc7c-c92a-43ad-845b-d8d560d639b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:49.903217 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-86e6dc7c-c92a-43ad-845b-d8d560d639b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:50.107177 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-86e6dc7c-c92a-43ad-845b-d8d560d639b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:50.116212 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-86e6dc7c-c92a-43ad-845b-d8d560d639b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:50.117849 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-86e6dc7c-c92a-43ad-845b-d8d560d639b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:50.119030 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-86e6dc7c-c92a-43ad-845b-d8d560d639b7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1723 microversion: 2.20 time: 0.242533 Dec 14 10:16:50.119577 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 547/1044] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:16:49 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:16:50.380572 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-ef36c11f-4979-4078-a2cd-caecfaa2913a tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:50.381177 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-ef36c11f-4979-4078-a2cd-caecfaa2913a tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:50.388262 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ef36c11f-4979-4078-a2cd-caecfaa2913a tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:50.388703 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ef36c11f-4979-4078-a2cd-caecfaa2913a tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:50.389455 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ef36c11f-4979-4078-a2cd-caecfaa2913a tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:50.389886 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ef36c11f-4979-4078-a2cd-caecfaa2913a tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:50.584370 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-ef36c11f-4979-4078-a2cd-caecfaa2913a tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:50.592418 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-ef36c11f-4979-4078-a2cd-caecfaa2913a tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1265 microversion: 2.1 time: 0.215620 Dec 14 10:16:50.592977 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 498/1045] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:50 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:51.137863 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-85da6cf9-af43-467d-b53a-804d9056b896 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:51.138492 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-85da6cf9-af43-467d-b53a-804d9056b896 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:51.145596 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-85da6cf9-af43-467d-b53a-804d9056b896 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:51.146061 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-85da6cf9-af43-467d-b53a-804d9056b896 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:51.146807 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-85da6cf9-af43-467d-b53a-804d9056b896 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:51.147234 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-85da6cf9-af43-467d-b53a-804d9056b896 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:51.354106 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-85da6cf9-af43-467d-b53a-804d9056b896 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:51.363516 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-85da6cf9-af43-467d-b53a-804d9056b896 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:51.365009 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-85da6cf9-af43-467d-b53a-804d9056b896 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:51.366175 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-85da6cf9-af43-467d-b53a-804d9056b896 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1723 microversion: 2.20 time: 0.232038 Dec 14 10:16:51.366802 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 548/1046] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:16:51 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:16:51.441513 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-bcab4a7f-e25c-493a-8cc4-f8e2e5757b93 req-f7e616b9-4987-4c8c-9f10-e171491d2b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c457d9c4-d3ef-4ae8-a78c-eb75762205aa", "name": "network-vif-plugged", "status": "completed", "tag": "4c4fd8bf-4fbe-4f99-a91b-0b9bd1365298"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:51.443783 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:16:51.443783 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:16:51.453018 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-bcab4a7f-e25c-493a-8cc4-f8e2e5757b93 req-f7e616b9-4987-4c8c-9f10-e171491d2b97 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:51.453469 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-bcab4a7f-e25c-493a-8cc4-f8e2e5757b93 req-f7e616b9-4987-4c8c-9f10-e171491d2b97 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:51.469303 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-bcab4a7f-e25c-493a-8cc4-f8e2e5757b93 req-f7e616b9-4987-4c8c-9f10-e171491d2b97 service nova] Creating event network-vif-plugged:4c4fd8bf-4fbe-4f99-a91b-0b9bd1365298 for instance c457d9c4-d3ef-4ae8-a78c-eb75762205aa on hv-cinder-81888 Dec 14 10:16:51.473818 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-bcab4a7f-e25c-493a-8cc4-f8e2e5757b93 req-f7e616b9-4987-4c8c-9f10-e171491d2b97 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037702 Dec 14 10:16:51.474437 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 499/1047] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:16:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:16:51.609082 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-3e3db82a-8abc-471b-b0c1-91d03b6c9cd5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:51.609824 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-3e3db82a-8abc-471b-b0c1-91d03b6c9cd5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:51.617572 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3e3db82a-8abc-471b-b0c1-91d03b6c9cd5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:51.618154 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3e3db82a-8abc-471b-b0c1-91d03b6c9cd5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:51.618926 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3e3db82a-8abc-471b-b0c1-91d03b6c9cd5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:51.619356 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-3e3db82a-8abc-471b-b0c1-91d03b6c9cd5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:51.822498 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-3e3db82a-8abc-471b-b0c1-91d03b6c9cd5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:51.830448 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-3e3db82a-8abc-471b-b0c1-91d03b6c9cd5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1265 microversion: 2.1 time: 0.225674 Dec 14 10:16:51.831004 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 549/1048] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:51 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:52.385145 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-689dd0a3-9cef-48d3-b2bd-cad9f356ae9d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:52.386002 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-689dd0a3-9cef-48d3-b2bd-cad9f356ae9d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:52.394116 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-689dd0a3-9cef-48d3-b2bd-cad9f356ae9d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:52.394571 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-689dd0a3-9cef-48d3-b2bd-cad9f356ae9d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:52.395347 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-689dd0a3-9cef-48d3-b2bd-cad9f356ae9d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:52.395782 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-689dd0a3-9cef-48d3-b2bd-cad9f356ae9d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:52.601186 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-689dd0a3-9cef-48d3-b2bd-cad9f356ae9d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:52.610251 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-689dd0a3-9cef-48d3-b2bd-cad9f356ae9d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:52.611737 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-689dd0a3-9cef-48d3-b2bd-cad9f356ae9d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:52.612871 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-689dd0a3-9cef-48d3-b2bd-cad9f356ae9d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1723 microversion: 2.20 time: 0.231930 Dec 14 10:16:52.613469 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 500/1049] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:16:52 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:16:52.847710 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-376947ff-c754-46cd-9c36-7623e5cd8abb tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:52.849120 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-376947ff-c754-46cd-9c36-7623e5cd8abb tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:52.856416 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-376947ff-c754-46cd-9c36-7623e5cd8abb tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:52.856861 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-376947ff-c754-46cd-9c36-7623e5cd8abb tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:52.857842 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-376947ff-c754-46cd-9c36-7623e5cd8abb tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:52.858319 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-376947ff-c754-46cd-9c36-7623e5cd8abb tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:53.062556 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-376947ff-c754-46cd-9c36-7623e5cd8abb tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:53.072263 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-376947ff-c754-46cd-9c36-7623e5cd8abb tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1452 microversion: 2.1 time: 0.228993 Dec 14 10:16:53.073228 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 550/1050] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:52 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1452 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:53.092440 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f9b96006-66b7-49c8-9592-e0e9559204d4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:53.093611 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f9b96006-66b7-49c8-9592-e0e9559204d4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:53.100877 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f9b96006-66b7-49c8-9592-e0e9559204d4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:53.101325 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f9b96006-66b7-49c8-9592-e0e9559204d4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:53.102136 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f9b96006-66b7-49c8-9592-e0e9559204d4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:53.102567 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f9b96006-66b7-49c8-9592-e0e9559204d4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:53.313195 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f9b96006-66b7-49c8-9592-e0e9559204d4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:53.321912 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f9b96006-66b7-49c8-9592-e0e9559204d4 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1452 microversion: 2.1 time: 0.233098 Dec 14 10:16:53.322586 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 501/1051] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:16:53 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1452 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:16:53.631354 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-c516715b-9586-4017-8d5a-a7688f96a373 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:53.632081 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-c516715b-9586-4017-8d5a-a7688f96a373 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:53.639406 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c516715b-9586-4017-8d5a-a7688f96a373 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:53.639947 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c516715b-9586-4017-8d5a-a7688f96a373 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:53.641437 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c516715b-9586-4017-8d5a-a7688f96a373 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:53.641875 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-c516715b-9586-4017-8d5a-a7688f96a373 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:53.843437 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c516715b-9586-4017-8d5a-a7688f96a373 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:53.852163 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c516715b-9586-4017-8d5a-a7688f96a373 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:53.853651 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-c516715b-9586-4017-8d5a-a7688f96a373 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:53.854806 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-c516715b-9586-4017-8d5a-a7688f96a373 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1723 microversion: 2.20 time: 0.227112 Dec 14 10:16:53.855354 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 551/1052] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:16:53 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:16:54.873206 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-66f7df49-27bc-4e41-a265-12e7188c51cb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:54.873982 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-66f7df49-27bc-4e41-a265-12e7188c51cb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:54.887357 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-66f7df49-27bc-4e41-a265-12e7188c51cb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:54.887801 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-66f7df49-27bc-4e41-a265-12e7188c51cb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:54.888594 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-66f7df49-27bc-4e41-a265-12e7188c51cb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:54.889048 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-66f7df49-27bc-4e41-a265-12e7188c51cb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:55.323664 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-66f7df49-27bc-4e41-a265-12e7188c51cb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:55.332740 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-66f7df49-27bc-4e41-a265-12e7188c51cb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:55.334260 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-66f7df49-27bc-4e41-a265-12e7188c51cb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:55.335417 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-66f7df49-27bc-4e41-a265-12e7188c51cb tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1723 microversion: 2.20 time: 0.465924 Dec 14 10:16:55.335978 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 502/1053] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:16:54 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1723 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:16:55.891433 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-95cadeec-bff0-4d42-b888-52a5f873700e req-550a0ae2-7434-4720-a0c5-5c6b12889006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c457d9c4-d3ef-4ae8-a78c-eb75762205aa", "tag": "4c4fd8bf-4fbe-4f99-a91b-0b9bd1365298"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:16:55.892971 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:16:55.892971 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:16:55.901300 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-95cadeec-bff0-4d42-b888-52a5f873700e req-550a0ae2-7434-4720-a0c5-5c6b12889006 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:55.902032 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-95cadeec-bff0-4d42-b888-52a5f873700e req-550a0ae2-7434-4720-a0c5-5c6b12889006 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:55.922508 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-95cadeec-bff0-4d42-b888-52a5f873700e req-550a0ae2-7434-4720-a0c5-5c6b12889006 service nova] Creating event network-changed:4c4fd8bf-4fbe-4f99-a91b-0b9bd1365298 for instance c457d9c4-d3ef-4ae8-a78c-eb75762205aa on hv-cinder-81888 Dec 14 10:16:55.927343 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-95cadeec-bff0-4d42-b888-52a5f873700e req-550a0ae2-7434-4720-a0c5-5c6b12889006 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045448 Dec 14 10:16:55.928146 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 552/1054] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:16:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:16:56.355088 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-9def874f-c010-4465-8aae-2c1058a4406c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:56.355841 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-9def874f-c010-4465-8aae-2c1058a4406c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:56.364519 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9def874f-c010-4465-8aae-2c1058a4406c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:56.364963 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9def874f-c010-4465-8aae-2c1058a4406c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:56.365935 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9def874f-c010-4465-8aae-2c1058a4406c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:56.366386 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9def874f-c010-4465-8aae-2c1058a4406c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:56.745537 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-9def874f-c010-4465-8aae-2c1058a4406c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:56.754972 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-9def874f-c010-4465-8aae-2c1058a4406c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:56.756589 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-9def874f-c010-4465-8aae-2c1058a4406c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:56.757981 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-9def874f-c010-4465-8aae-2c1058a4406c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1723 microversion: 2.20 time: 0.407143 Dec 14 10:16:56.758902 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 503/1055] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:16:56 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1723 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:16:57.777389 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e9822526-e52d-47f6-a52d-10d294189f27 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:57.778090 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e9822526-e52d-47f6-a52d-10d294189f27 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:57.785571 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e9822526-e52d-47f6-a52d-10d294189f27 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:57.786047 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e9822526-e52d-47f6-a52d-10d294189f27 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:57.786796 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e9822526-e52d-47f6-a52d-10d294189f27 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:57.787222 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e9822526-e52d-47f6-a52d-10d294189f27 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:58.061502 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e9822526-e52d-47f6-a52d-10d294189f27 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:58.070240 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e9822526-e52d-47f6-a52d-10d294189f27 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:58.071765 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e9822526-e52d-47f6-a52d-10d294189f27 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:58.072882 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e9822526-e52d-47f6-a52d-10d294189f27 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1723 microversion: 2.20 time: 0.299895 Dec 14 10:16:58.073432 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 553/1056] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:16:57 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:16:59.090621 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-02bc89e3-be0d-4786-a079-87584402d354 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:16:59.091266 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-02bc89e3-be0d-4786-a079-87584402d354 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:16:59.098664 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-02bc89e3-be0d-4786-a079-87584402d354 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:59.099113 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-02bc89e3-be0d-4786-a079-87584402d354 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:59.099880 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-02bc89e3-be0d-4786-a079-87584402d354 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:16:59.100314 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-02bc89e3-be0d-4786-a079-87584402d354 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:16:59.296579 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-02bc89e3-be0d-4786-a079-87584402d354 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:59.305095 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-02bc89e3-be0d-4786-a079-87584402d354 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:59.306583 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-02bc89e3-be0d-4786-a079-87584402d354 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:16:59.307709 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-02bc89e3-be0d-4786-a079-87584402d354 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1723 microversion: 2.20 time: 0.220824 Dec 14 10:16:59.308256 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 504/1057] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:16:59 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:00.326338 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-9c582b45-f729-4843-b65f-748c5d12c5fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:00.326860 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-9c582b45-f729-4843-b65f-748c5d12c5fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:00.334741 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9c582b45-f729-4843-b65f-748c5d12c5fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:00.335175 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9c582b45-f729-4843-b65f-748c5d12c5fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:00.335924 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9c582b45-f729-4843-b65f-748c5d12c5fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:00.336348 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9c582b45-f729-4843-b65f-748c5d12c5fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:00.529292 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-9c582b45-f729-4843-b65f-748c5d12c5fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:00.538123 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-9c582b45-f729-4843-b65f-748c5d12c5fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:00.539621 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-9c582b45-f729-4843-b65f-748c5d12c5fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:00.540732 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-9c582b45-f729-4843-b65f-748c5d12c5fa tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1723 microversion: 2.20 time: 0.218158 Dec 14 10:17:00.541280 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 554/1058] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:00 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:01.559821 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-84c5de77-1e19-4e78-b844-211a09ff5b4a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:01.560430 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-84c5de77-1e19-4e78-b844-211a09ff5b4a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:01.568777 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-84c5de77-1e19-4e78-b844-211a09ff5b4a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:01.569225 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-84c5de77-1e19-4e78-b844-211a09ff5b4a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:01.570008 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-84c5de77-1e19-4e78-b844-211a09ff5b4a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:01.570449 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-84c5de77-1e19-4e78-b844-211a09ff5b4a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:01.767052 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-84c5de77-1e19-4e78-b844-211a09ff5b4a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:01.777313 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-84c5de77-1e19-4e78-b844-211a09ff5b4a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:01.778829 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-84c5de77-1e19-4e78-b844-211a09ff5b4a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:01.779938 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-84c5de77-1e19-4e78-b844-211a09ff5b4a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1723 microversion: 2.20 time: 0.223925 Dec 14 10:17:01.780998 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 505/1059] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:01 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:02.798715 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-886a6f61-09b1-4a9e-b7be-f8c16a90dc33 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:02.799317 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-886a6f61-09b1-4a9e-b7be-f8c16a90dc33 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:02.806471 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-886a6f61-09b1-4a9e-b7be-f8c16a90dc33 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:02.806909 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-886a6f61-09b1-4a9e-b7be-f8c16a90dc33 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:02.807682 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-886a6f61-09b1-4a9e-b7be-f8c16a90dc33 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:02.808104 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-886a6f61-09b1-4a9e-b7be-f8c16a90dc33 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:03.004661 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-886a6f61-09b1-4a9e-b7be-f8c16a90dc33 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:03.013123 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-886a6f61-09b1-4a9e-b7be-f8c16a90dc33 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:03.014924 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-886a6f61-09b1-4a9e-b7be-f8c16a90dc33 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:03.016007 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-886a6f61-09b1-4a9e-b7be-f8c16a90dc33 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1723 microversion: 2.20 time: 0.221525 Dec 14 10:17:03.016567 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 555/1060] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:02 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:04.034531 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-5efc3a00-073b-4663-b86d-4647f0383574 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:04.035131 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-5efc3a00-073b-4663-b86d-4647f0383574 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:04.042344 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5efc3a00-073b-4663-b86d-4647f0383574 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:04.042789 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5efc3a00-073b-4663-b86d-4647f0383574 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:04.043544 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5efc3a00-073b-4663-b86d-4647f0383574 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:04.043971 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5efc3a00-073b-4663-b86d-4647f0383574 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:04.242556 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-5efc3a00-073b-4663-b86d-4647f0383574 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:04.251058 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-5efc3a00-073b-4663-b86d-4647f0383574 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:04.252547 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-5efc3a00-073b-4663-b86d-4647f0383574 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:04.253651 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-5efc3a00-073b-4663-b86d-4647f0383574 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1723 microversion: 2.20 time: 0.222942 Dec 14 10:17:04.254228 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 506/1061] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:04 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:05.272571 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-69a2ffb7-6855-4ad8-9193-274987795da8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:05.273168 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-69a2ffb7-6855-4ad8-9193-274987795da8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:05.280852 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-69a2ffb7-6855-4ad8-9193-274987795da8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:05.281295 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-69a2ffb7-6855-4ad8-9193-274987795da8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:05.282067 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-69a2ffb7-6855-4ad8-9193-274987795da8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:05.282492 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-69a2ffb7-6855-4ad8-9193-274987795da8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:05.476572 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-69a2ffb7-6855-4ad8-9193-274987795da8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:05.485725 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-69a2ffb7-6855-4ad8-9193-274987795da8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:05.487227 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-69a2ffb7-6855-4ad8-9193-274987795da8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:05.488328 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-69a2ffb7-6855-4ad8-9193-274987795da8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1723 microversion: 2.20 time: 0.219558 Dec 14 10:17:05.488878 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 556/1062] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:05 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:06.505683 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6894ceb2-7f29-427d-9b02-1b22b2058a61 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:06.506321 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6894ceb2-7f29-427d-9b02-1b22b2058a61 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:06.513334 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6894ceb2-7f29-427d-9b02-1b22b2058a61 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:06.513775 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6894ceb2-7f29-427d-9b02-1b22b2058a61 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:06.515103 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6894ceb2-7f29-427d-9b02-1b22b2058a61 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:06.515535 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6894ceb2-7f29-427d-9b02-1b22b2058a61 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:06.704998 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-6894ceb2-7f29-427d-9b02-1b22b2058a61 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:06.713497 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-6894ceb2-7f29-427d-9b02-1b22b2058a61 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:06.715028 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-6894ceb2-7f29-427d-9b02-1b22b2058a61 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:06.716186 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6894ceb2-7f29-427d-9b02-1b22b2058a61 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1723 microversion: 2.20 time: 0.214150 Dec 14 10:17:06.716738 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 507/1063] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:06 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:07.735521 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-677f385a-61b3-449d-ae56-bc3199561702 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:07.736137 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-677f385a-61b3-449d-ae56-bc3199561702 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:07.743788 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-677f385a-61b3-449d-ae56-bc3199561702 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:07.744225 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-677f385a-61b3-449d-ae56-bc3199561702 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:07.744975 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-677f385a-61b3-449d-ae56-bc3199561702 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:07.745402 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-677f385a-61b3-449d-ae56-bc3199561702 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:07.936276 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-677f385a-61b3-449d-ae56-bc3199561702 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:07.944841 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-677f385a-61b3-449d-ae56-bc3199561702 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:07.946546 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-677f385a-61b3-449d-ae56-bc3199561702 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:07.947650 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-677f385a-61b3-449d-ae56-bc3199561702 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1723 microversion: 2.20 time: 0.216473 Dec 14 10:17:07.948194 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 557/1064] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:07 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:17:08.965364 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-74c9253e-5292-44bb-bc0f-7132a386f000 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:08.965997 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-74c9253e-5292-44bb-bc0f-7132a386f000 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:08.977631 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-74c9253e-5292-44bb-bc0f-7132a386f000 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:08.978104 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-74c9253e-5292-44bb-bc0f-7132a386f000 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:08.978877 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-74c9253e-5292-44bb-bc0f-7132a386f000 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:08.979313 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-74c9253e-5292-44bb-bc0f-7132a386f000 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:09.181588 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-74c9253e-5292-44bb-bc0f-7132a386f000 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:09.190140 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-74c9253e-5292-44bb-bc0f-7132a386f000 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:09.191638 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-74c9253e-5292-44bb-bc0f-7132a386f000 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:09.192748 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-74c9253e-5292-44bb-bc0f-7132a386f000 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1723 microversion: 2.20 time: 0.231179 Dec 14 10:17:09.193307 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 508/1065] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:08 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:10.210696 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-7a98617a-5fe6-4591-9c52-8a168b6f2117 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:10.211293 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-7a98617a-5fe6-4591-9c52-8a168b6f2117 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:10.218508 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7a98617a-5fe6-4591-9c52-8a168b6f2117 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:10.218944 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7a98617a-5fe6-4591-9c52-8a168b6f2117 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:10.219692 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7a98617a-5fe6-4591-9c52-8a168b6f2117 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:10.220186 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7a98617a-5fe6-4591-9c52-8a168b6f2117 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:10.415112 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-7a98617a-5fe6-4591-9c52-8a168b6f2117 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:10.424268 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-7a98617a-5fe6-4591-9c52-8a168b6f2117 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:10.425747 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-7a98617a-5fe6-4591-9c52-8a168b6f2117 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:10.426876 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-7a98617a-5fe6-4591-9c52-8a168b6f2117 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1744 microversion: 2.20 time: 0.219877 Dec 14 10:17:10.427431 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 558/1066] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:10 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1744 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:11.444740 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-d1e51016-fee0-4078-9fa1-c990dc90cfe8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:11.445516 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-d1e51016-fee0-4078-9fa1-c990dc90cfe8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:11.452955 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d1e51016-fee0-4078-9fa1-c990dc90cfe8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:11.453397 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d1e51016-fee0-4078-9fa1-c990dc90cfe8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:11.454219 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d1e51016-fee0-4078-9fa1-c990dc90cfe8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:11.454645 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d1e51016-fee0-4078-9fa1-c990dc90cfe8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:11.666828 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-d1e51016-fee0-4078-9fa1-c990dc90cfe8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:11.699267 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-d1e51016-fee0-4078-9fa1-c990dc90cfe8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:11.702090 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-d1e51016-fee0-4078-9fa1-c990dc90cfe8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:11.703588 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-d1e51016-fee0-4078-9fa1-c990dc90cfe8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1739 microversion: 2.20 time: 0.262513 Dec 14 10:17:11.704318 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 509/1067] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:11 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:17:12.722568 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-9c37749f-fcba-4bcc-9940-7ec2df97a924 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:12.723496 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-9c37749f-fcba-4bcc-9940-7ec2df97a924 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:12.730878 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9c37749f-fcba-4bcc-9940-7ec2df97a924 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:12.731324 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9c37749f-fcba-4bcc-9940-7ec2df97a924 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:12.732073 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9c37749f-fcba-4bcc-9940-7ec2df97a924 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:12.732612 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9c37749f-fcba-4bcc-9940-7ec2df97a924 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:12.941137 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-9c37749f-fcba-4bcc-9940-7ec2df97a924 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:12.951653 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-9c37749f-fcba-4bcc-9940-7ec2df97a924 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:12.953765 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-9c37749f-fcba-4bcc-9940-7ec2df97a924 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:12.955060 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-9c37749f-fcba-4bcc-9940-7ec2df97a924 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1739 microversion: 2.20 time: 0.236378 Dec 14 10:17:12.968610 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 559/1068] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:12 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:13.694563 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-895b4092-19b4-44d5-81b4-23457db31ebf req-ad4d2f18-0381-41ea-b8bc-fae19d898923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc8d226a-4c08-4a07-94a7-f7c17c509a27", "name": "network-vif-plugged", "status": "completed", "tag": "aa6402ff-8882-4a58-b152-b056853240b9"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:17:13.696722 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:17:13.696722 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:17:13.713190 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-895b4092-19b4-44d5-81b4-23457db31ebf req-ad4d2f18-0381-41ea-b8bc-fae19d898923 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:13.713764 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-895b4092-19b4-44d5-81b4-23457db31ebf req-ad4d2f18-0381-41ea-b8bc-fae19d898923 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:13.735286 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-895b4092-19b4-44d5-81b4-23457db31ebf req-ad4d2f18-0381-41ea-b8bc-fae19d898923 service nova] Creating event network-vif-plugged:aa6402ff-8882-4a58-b152-b056853240b9 for instance cc8d226a-4c08-4a07-94a7-f7c17c509a27 on hv-cinder-81888 Dec 14 10:17:13.746578 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-895b4092-19b4-44d5-81b4-23457db31ebf req-ad4d2f18-0381-41ea-b8bc-fae19d898923 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056742 Dec 14 10:17:13.747462 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 510/1069] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:17:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:17:13.976657 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-522d3ab6-045d-4091-a8ea-6f07ece0e0bf tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:13.977428 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-522d3ab6-045d-4091-a8ea-6f07ece0e0bf tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:13.984798 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-522d3ab6-045d-4091-a8ea-6f07ece0e0bf tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:13.985573 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-522d3ab6-045d-4091-a8ea-6f07ece0e0bf tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:13.986614 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-522d3ab6-045d-4091-a8ea-6f07ece0e0bf tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:13.987286 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-522d3ab6-045d-4091-a8ea-6f07ece0e0bf tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:14.234883 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-522d3ab6-045d-4091-a8ea-6f07ece0e0bf tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:14.244573 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-522d3ab6-045d-4091-a8ea-6f07ece0e0bf tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:14.246122 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-522d3ab6-045d-4091-a8ea-6f07ece0e0bf tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:14.247343 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-522d3ab6-045d-4091-a8ea-6f07ece0e0bf tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1739 microversion: 2.20 time: 0.274372 Dec 14 10:17:14.248179 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 560/1070] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:13 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:15.266517 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f36e2767-697e-4214-be5d-f0f32ded00c2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:15.267690 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f36e2767-697e-4214-be5d-f0f32ded00c2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:15.280063 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f36e2767-697e-4214-be5d-f0f32ded00c2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:15.280784 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f36e2767-697e-4214-be5d-f0f32ded00c2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:15.281721 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f36e2767-697e-4214-be5d-f0f32ded00c2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:15.282335 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f36e2767-697e-4214-be5d-f0f32ded00c2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:15.515763 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f36e2767-697e-4214-be5d-f0f32ded00c2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:15.528503 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f36e2767-697e-4214-be5d-f0f32ded00c2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:15.530348 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f36e2767-697e-4214-be5d-f0f32ded00c2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:15.531772 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f36e2767-697e-4214-be5d-f0f32ded00c2 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1739 microversion: 2.20 time: 0.269485 Dec 14 10:17:15.532369 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 511/1071] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:15 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:16.550820 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5468bfb7-1418-40e1-9682-751b6c508f84 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:16.552431 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5468bfb7-1418-40e1-9682-751b6c508f84 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:16.559434 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5468bfb7-1418-40e1-9682-751b6c508f84 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:16.559882 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5468bfb7-1418-40e1-9682-751b6c508f84 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:16.562418 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5468bfb7-1418-40e1-9682-751b6c508f84 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:16.562848 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5468bfb7-1418-40e1-9682-751b6c508f84 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:16.805024 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5468bfb7-1418-40e1-9682-751b6c508f84 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:16.814293 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5468bfb7-1418-40e1-9682-751b6c508f84 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:16.815924 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5468bfb7-1418-40e1-9682-751b6c508f84 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:16.817100 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5468bfb7-1418-40e1-9682-751b6c508f84 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1739 microversion: 2.20 time: 0.270872 Dec 14 10:17:16.817665 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 561/1072] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:16 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:17:17.834695 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c59e3f02-a8ba-4581-9d71-f04ca4ca505a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:17.835938 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-c59e3f02-a8ba-4581-9d71-f04ca4ca505a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:17.844262 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c59e3f02-a8ba-4581-9d71-f04ca4ca505a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:17.844719 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c59e3f02-a8ba-4581-9d71-f04ca4ca505a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:17.845520 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c59e3f02-a8ba-4581-9d71-f04ca4ca505a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:17.846022 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-c59e3f02-a8ba-4581-9d71-f04ca4ca505a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:18.187683 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-c59e3f02-a8ba-4581-9d71-f04ca4ca505a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:18.196546 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-c59e3f02-a8ba-4581-9d71-f04ca4ca505a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:18.198063 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-c59e3f02-a8ba-4581-9d71-f04ca4ca505a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:18.199473 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c59e3f02-a8ba-4581-9d71-f04ca4ca505a tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1739 microversion: 2.20 time: 0.368752 Dec 14 10:17:18.210832 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 512/1073] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:17 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1739 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:19.217765 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-9e3e5f03-1e64-4086-a049-223fae2d2f26 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:19.222697 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-9e3e5f03-1e64-4086-a049-223fae2d2f26 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:19.230555 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9e3e5f03-1e64-4086-a049-223fae2d2f26 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:19.231464 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9e3e5f03-1e64-4086-a049-223fae2d2f26 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:19.232632 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9e3e5f03-1e64-4086-a049-223fae2d2f26 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:19.233530 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-9e3e5f03-1e64-4086-a049-223fae2d2f26 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:19.486340 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-9e3e5f03-1e64-4086-a049-223fae2d2f26 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:19.496412 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-9e3e5f03-1e64-4086-a049-223fae2d2f26 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:19.497903 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-9e3e5f03-1e64-4086-a049-223fae2d2f26 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:19.499298 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-9e3e5f03-1e64-4086-a049-223fae2d2f26 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1739 microversion: 2.20 time: 0.285203 Dec 14 10:17:19.502016 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 562/1074] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:19 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:20.518263 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-385a9d9c-f691-4927-9780-7caaf00809e7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:20.518909 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-385a9d9c-f691-4927-9780-7caaf00809e7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:20.526182 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-385a9d9c-f691-4927-9780-7caaf00809e7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:20.526894 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-385a9d9c-f691-4927-9780-7caaf00809e7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:20.527664 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-385a9d9c-f691-4927-9780-7caaf00809e7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:20.528098 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-385a9d9c-f691-4927-9780-7caaf00809e7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:20.720037 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-385a9d9c-f691-4927-9780-7caaf00809e7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:20.729400 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-385a9d9c-f691-4927-9780-7caaf00809e7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:20.730936 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-385a9d9c-f691-4927-9780-7caaf00809e7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:20.732062 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-385a9d9c-f691-4927-9780-7caaf00809e7 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1739 microversion: 2.20 time: 0.217644 Dec 14 10:17:20.732613 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 513/1075] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:20 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:21.750152 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-49b515dc-9b08-43c1-9fa6-a3a9d02e6390 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:21.750754 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-49b515dc-9b08-43c1-9fa6-a3a9d02e6390 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:21.757932 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49b515dc-9b08-43c1-9fa6-a3a9d02e6390 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:21.758401 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49b515dc-9b08-43c1-9fa6-a3a9d02e6390 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:21.759151 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49b515dc-9b08-43c1-9fa6-a3a9d02e6390 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:21.759584 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-49b515dc-9b08-43c1-9fa6-a3a9d02e6390 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:21.959847 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-49b515dc-9b08-43c1-9fa6-a3a9d02e6390 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:21.968265 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-49b515dc-9b08-43c1-9fa6-a3a9d02e6390 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:21.969731 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-49b515dc-9b08-43c1-9fa6-a3a9d02e6390 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:21.970891 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-49b515dc-9b08-43c1-9fa6-a3a9d02e6390 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1721 microversion: 2.20 time: 0.224446 Dec 14 10:17:21.971438 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 563/1076] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:21 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:22.988841 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-5c03d3d6-2921-4eb3-a762-ffa6b0dd9597 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:22.989455 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-5c03d3d6-2921-4eb3-a762-ffa6b0dd9597 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:22.996740 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5c03d3d6-2921-4eb3-a762-ffa6b0dd9597 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:22.997190 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5c03d3d6-2921-4eb3-a762-ffa6b0dd9597 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:22.997979 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5c03d3d6-2921-4eb3-a762-ffa6b0dd9597 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:22.998417 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5c03d3d6-2921-4eb3-a762-ffa6b0dd9597 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:23.295961 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-5c03d3d6-2921-4eb3-a762-ffa6b0dd9597 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:23.305512 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-5c03d3d6-2921-4eb3-a762-ffa6b0dd9597 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:23.307113 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-5c03d3d6-2921-4eb3-a762-ffa6b0dd9597 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:23.308371 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-5c03d3d6-2921-4eb3-a762-ffa6b0dd9597 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1721 microversion: 2.20 time: 0.323514 Dec 14 10:17:23.308918 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 514/1077] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:22 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1721 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:24.333193 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-03839395-853a-4451-80a2-a7556a19b706 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:24.333735 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-03839395-853a-4451-80a2-a7556a19b706 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:24.340838 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-03839395-853a-4451-80a2-a7556a19b706 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:24.341285 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-03839395-853a-4451-80a2-a7556a19b706 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:24.342072 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-03839395-853a-4451-80a2-a7556a19b706 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:24.342502 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-03839395-853a-4451-80a2-a7556a19b706 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:24.538750 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-03839395-853a-4451-80a2-a7556a19b706 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:24.547162 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-03839395-853a-4451-80a2-a7556a19b706 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:24.548628 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-03839395-853a-4451-80a2-a7556a19b706 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:24.549867 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-03839395-853a-4451-80a2-a7556a19b706 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1664 microversion: 2.20 time: 0.220591 Dec 14 10:17:24.550447 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 564/1078] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:24 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1664 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:24.567091 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-25f9d1ff-0f49-4c07-9d01-94072decf47d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abe67455-957c-430b-a9f3-9af3699ec231"}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:17:24.568119 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-25f9d1ff-0f49-4c07-9d01-94072decf47d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:24.575151 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-25f9d1ff-0f49-4c07-9d01-94072decf47d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:24.575590 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-25f9d1ff-0f49-4c07-9d01-94072decf47d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:24.576344 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-25f9d1ff-0f49-4c07-9d01-94072decf47d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:24.576769 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-25f9d1ff-0f49-4c07-9d01-94072decf47d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:24.988226 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-25f9d1ff-0f49-4c07-9d01-94072decf47d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.424925 Dec 14 10:17:24.989143 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 515/1079] 10.222.0.20 () {62 vars in 1363 bytes} [Tue Dec 14 10:17:24 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/os-volume_attachments => generated 188 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 14 10:17:25.160880 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-64ba3ff8-3580-4096-9a13-9a81ce843f5c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:25.161366 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-64ba3ff8-3580-4096-9a13-9a81ce843f5c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:25.168437 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-64ba3ff8-3580-4096-9a13-9a81ce843f5c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:25.168879 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-64ba3ff8-3580-4096-9a13-9a81ce843f5c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:25.169623 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-64ba3ff8-3580-4096-9a13-9a81ce843f5c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:25.170070 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-64ba3ff8-3580-4096-9a13-9a81ce843f5c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:25.459216 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-b98eeb51-0ddb-4f3c-be89-177d705bcaed req-632ead6d-c534-4386-9094-e96a907d8bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc8d226a-4c08-4a07-94a7-f7c17c509a27", "name": "network-vif-unplugged", "status": "completed", "tag": "aa6402ff-8882-4a58-b152-b056853240b9"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:17:25.460913 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:17:25.460913 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:17:25.471523 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-b98eeb51-0ddb-4f3c-be89-177d705bcaed req-632ead6d-c534-4386-9094-e96a907d8bc7 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:25.471962 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-b98eeb51-0ddb-4f3c-be89-177d705bcaed req-632ead6d-c534-4386-9094-e96a907d8bc7 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:25.488084 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.compute.server_external_events [req-b98eeb51-0ddb-4f3c-be89-177d705bcaed req-632ead6d-c534-4386-9094-e96a907d8bc7 service nova] Unable to find a host for instance cc8d226a-4c08-4a07-94a7-f7c17c509a27. Dropping event network-vif-unplugged {{(pid=100985) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 14 10:17:25.488938 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-b98eeb51-0ddb-4f3c-be89-177d705bcaed req-632ead6d-c534-4386-9094-e96a907d8bc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033946 Dec 14 10:17:25.489687 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 516/1080] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:17:25 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 14 10:17:25.583189 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-64ba3ff8-3580-4096-9a13-9a81ce843f5c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/os-volume_attachments/abe67455-957c-430b-a9f3-9af3699ec231" status: 202 len: 0 microversion: 2.20 time: 0.426114 Dec 14 10:17:25.583755 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 565/1081] 10.222.0.20 () {60 vars in 1456 bytes} [Tue Dec 14 10:17:25 2021] DELETE /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/os-volume_attachments/abe67455-957c-430b-a9f3-9af3699ec231 => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 14 10:17:25.668650 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-0253dfde-bfec-4f4b-b043-db15ece56549 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:17:25.669213 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-0253dfde-bfec-4f4b-b043-db15ece56549 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:25.677046 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0253dfde-bfec-4f4b-b043-db15ece56549 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:25.677431 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0253dfde-bfec-4f4b-b043-db15ece56549 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:25.678229 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0253dfde-bfec-4f4b-b043-db15ece56549 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:25.678667 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-0253dfde-bfec-4f4b-b043-db15ece56549 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:25.824285 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-0253dfde-bfec-4f4b-b043-db15ece56549 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action" status: 202 len: 0 microversion: 2.20 time: 0.159325 Dec 14 10:17:25.827777 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 517/1082] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Dec 14 10:17:25 2021] POST /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 14 10:17:25.833318 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8ab365a7-e6cd-4337-ac4b-47bce97315e0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:25.834027 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-8ab365a7-e6cd-4337-ac4b-47bce97315e0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:25.841303 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8ab365a7-e6cd-4337-ac4b-47bce97315e0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:25.841755 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8ab365a7-e6cd-4337-ac4b-47bce97315e0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:25.842527 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8ab365a7-e6cd-4337-ac4b-47bce97315e0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:25.842948 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8ab365a7-e6cd-4337-ac4b-47bce97315e0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:26.045466 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-8ab365a7-e6cd-4337-ac4b-47bce97315e0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:26.054853 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-8ab365a7-e6cd-4337-ac4b-47bce97315e0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:26.057006 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-8ab365a7-e6cd-4337-ac4b-47bce97315e0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:26.058240 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8ab365a7-e6cd-4337-ac4b-47bce97315e0 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1672 microversion: 2.20 time: 0.229088 Dec 14 10:17:26.058793 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 566/1083] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:25 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1672 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:27.076475 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-1a467810-cd53-4788-8384-0b798869e127 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:27.077090 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-1a467810-cd53-4788-8384-0b798869e127 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:27.084390 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1a467810-cd53-4788-8384-0b798869e127 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:27.084836 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1a467810-cd53-4788-8384-0b798869e127 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:27.085608 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1a467810-cd53-4788-8384-0b798869e127 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:27.086068 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-1a467810-cd53-4788-8384-0b798869e127 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:27.471965 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-1a467810-cd53-4788-8384-0b798869e127 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:27.480571 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-1a467810-cd53-4788-8384-0b798869e127 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:27.482185 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-1a467810-cd53-4788-8384-0b798869e127 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:27.483319 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-1a467810-cd53-4788-8384-0b798869e127 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1730 microversion: 2.20 time: 0.410599 Dec 14 10:17:27.483875 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 518/1084] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:27 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1730 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:28.512138 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-6f32f14c-fbc7-41c7-96cf-c81932f1e49d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:28.512791 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-6f32f14c-fbc7-41c7-96cf-c81932f1e49d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:28.522534 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6f32f14c-fbc7-41c7-96cf-c81932f1e49d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:28.523042 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6f32f14c-fbc7-41c7-96cf-c81932f1e49d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:28.523892 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6f32f14c-fbc7-41c7-96cf-c81932f1e49d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:28.524335 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-6f32f14c-fbc7-41c7-96cf-c81932f1e49d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:28.744629 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-6f32f14c-fbc7-41c7-96cf-c81932f1e49d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:28.754687 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-6f32f14c-fbc7-41c7-96cf-c81932f1e49d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:28.756169 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-6f32f14c-fbc7-41c7-96cf-c81932f1e49d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:28.757363 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-6f32f14c-fbc7-41c7-96cf-c81932f1e49d tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1730 microversion: 2.20 time: 0.250512 Dec 14 10:17:28.757919 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 567/1085] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:28 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1730 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:29.776004 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6711ed62-df9c-4927-a587-d9978b21c34c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:29.776990 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6711ed62-df9c-4927-a587-d9978b21c34c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:29.788267 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6711ed62-df9c-4927-a587-d9978b21c34c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:29.788709 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6711ed62-df9c-4927-a587-d9978b21c34c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:29.789485 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6711ed62-df9c-4927-a587-d9978b21c34c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:29.789913 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6711ed62-df9c-4927-a587-d9978b21c34c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:30.040685 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-6711ed62-df9c-4927-a587-d9978b21c34c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:30.055616 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-6711ed62-df9c-4927-a587-d9978b21c34c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:30.057139 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-6711ed62-df9c-4927-a587-d9978b21c34c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:30.058325 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6711ed62-df9c-4927-a587-d9978b21c34c tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1730 microversion: 2.20 time: 0.286062 Dec 14 10:17:30.069263 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 519/1086] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:29 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1730 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:31.076922 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-a571fa18-b556-4cc0-b036-3c11e4aa17ef tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:31.077539 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-a571fa18-b556-4cc0-b036-3c11e4aa17ef tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:31.085496 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a571fa18-b556-4cc0-b036-3c11e4aa17ef tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:31.085946 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a571fa18-b556-4cc0-b036-3c11e4aa17ef tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:31.086752 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a571fa18-b556-4cc0-b036-3c11e4aa17ef tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:31.087184 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-a571fa18-b556-4cc0-b036-3c11e4aa17ef tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:31.289874 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-a571fa18-b556-4cc0-b036-3c11e4aa17ef tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:31.299351 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-a571fa18-b556-4cc0-b036-3c11e4aa17ef tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:31.300856 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-a571fa18-b556-4cc0-b036-3c11e4aa17ef tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:31.302022 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-a571fa18-b556-4cc0-b036-3c11e4aa17ef tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1730 microversion: 2.20 time: 0.229049 Dec 14 10:17:31.302783 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 568/1087] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:31 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:32.320813 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-08a26b84-d4d3-4aff-8a20-d9538a1d5994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:32.321369 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-08a26b84-d4d3-4aff-8a20-d9538a1d5994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:32.328584 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-08a26b84-d4d3-4aff-8a20-d9538a1d5994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:32.329028 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-08a26b84-d4d3-4aff-8a20-d9538a1d5994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:32.329793 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-08a26b84-d4d3-4aff-8a20-d9538a1d5994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:32.330821 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-08a26b84-d4d3-4aff-8a20-d9538a1d5994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:32.534534 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-08a26b84-d4d3-4aff-8a20-d9538a1d5994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:32.543649 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-08a26b84-d4d3-4aff-8a20-d9538a1d5994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:32.545151 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-08a26b84-d4d3-4aff-8a20-d9538a1d5994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:32.546298 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-08a26b84-d4d3-4aff-8a20-d9538a1d5994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1730 microversion: 2.20 time: 0.229224 Dec 14 10:17:32.546853 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 520/1088] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:32 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:33.564990 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1ca2bcb1-c7ed-4eb0-bac8-744af464d969 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:33.565754 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1ca2bcb1-c7ed-4eb0-bac8-744af464d969 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:33.573814 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1ca2bcb1-c7ed-4eb0-bac8-744af464d969 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:33.575202 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1ca2bcb1-c7ed-4eb0-bac8-744af464d969 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:33.575202 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1ca2bcb1-c7ed-4eb0-bac8-744af464d969 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:33.575592 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1ca2bcb1-c7ed-4eb0-bac8-744af464d969 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:33.777789 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1ca2bcb1-c7ed-4eb0-bac8-744af464d969 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:33.787607 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1ca2bcb1-c7ed-4eb0-bac8-744af464d969 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:33.789096 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1ca2bcb1-c7ed-4eb0-bac8-744af464d969 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:33.790237 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1ca2bcb1-c7ed-4eb0-bac8-744af464d969 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1730 microversion: 2.20 time: 0.229563 Dec 14 10:17:33.790784 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 569/1089] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:33 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1730 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:34.810037 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-16228971-691e-4341-9dd2-aa30e38fd994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:34.812156 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-16228971-691e-4341-9dd2-aa30e38fd994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:34.822840 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-16228971-691e-4341-9dd2-aa30e38fd994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:34.823437 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-16228971-691e-4341-9dd2-aa30e38fd994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:34.824230 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-16228971-691e-4341-9dd2-aa30e38fd994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:34.824751 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-16228971-691e-4341-9dd2-aa30e38fd994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:35.045794 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-16228971-691e-4341-9dd2-aa30e38fd994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:35.056542 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-16228971-691e-4341-9dd2-aa30e38fd994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:35.058074 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-16228971-691e-4341-9dd2-aa30e38fd994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:35.059232 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-16228971-691e-4341-9dd2-aa30e38fd994 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1730 microversion: 2.20 time: 0.254010 Dec 14 10:17:35.071906 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 521/1090] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:34 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1730 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:36.078387 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-69877b2f-7eef-47fb-b069-67616e04c312 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:36.078996 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-69877b2f-7eef-47fb-b069-67616e04c312 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:36.086495 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-69877b2f-7eef-47fb-b069-67616e04c312 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:36.086931 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-69877b2f-7eef-47fb-b069-67616e04c312 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:36.087558 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-69877b2f-7eef-47fb-b069-67616e04c312 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:36.087952 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-69877b2f-7eef-47fb-b069-67616e04c312 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:36.293603 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-69877b2f-7eef-47fb-b069-67616e04c312 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:36.305334 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-69877b2f-7eef-47fb-b069-67616e04c312 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:36.307116 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-69877b2f-7eef-47fb-b069-67616e04c312 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:36.308246 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-69877b2f-7eef-47fb-b069-67616e04c312 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1730 microversion: 2.20 time: 0.233569 Dec 14 10:17:36.308802 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 570/1091] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:36 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1730 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:37.327436 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-71177785-452e-4678-ba7c-b516e6b4c981 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:37.328378 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-71177785-452e-4678-ba7c-b516e6b4c981 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:37.335788 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-71177785-452e-4678-ba7c-b516e6b4c981 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:37.336238 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-71177785-452e-4678-ba7c-b516e6b4c981 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:37.337012 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-71177785-452e-4678-ba7c-b516e6b4c981 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:37.337450 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-71177785-452e-4678-ba7c-b516e6b4c981 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:37.552032 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-71177785-452e-4678-ba7c-b516e6b4c981 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:37.561348 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-71177785-452e-4678-ba7c-b516e6b4c981 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:37.563053 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-71177785-452e-4678-ba7c-b516e6b4c981 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:37.564719 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-71177785-452e-4678-ba7c-b516e6b4c981 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1730 microversion: 2.20 time: 0.241425 Dec 14 10:17:37.565280 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 522/1092] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:37 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:38.583502 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-5cb23784-131d-446d-b52c-0aae66c5699e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:38.584102 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-5cb23784-131d-446d-b52c-0aae66c5699e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:38.591301 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5cb23784-131d-446d-b52c-0aae66c5699e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:38.591734 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5cb23784-131d-446d-b52c-0aae66c5699e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:38.592484 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5cb23784-131d-446d-b52c-0aae66c5699e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:38.592909 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-5cb23784-131d-446d-b52c-0aae66c5699e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:38.789676 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5cb23784-131d-446d-b52c-0aae66c5699e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:38.798295 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5cb23784-131d-446d-b52c-0aae66c5699e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:38.800308 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-5cb23784-131d-446d-b52c-0aae66c5699e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:38.801448 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-5cb23784-131d-446d-b52c-0aae66c5699e tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1730 microversion: 2.20 time: 0.222376 Dec 14 10:17:38.802027 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 571/1093] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:38 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1730 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:39.820478 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f018fe18-03f2-4871-9231-d18bc06018fc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:39.821122 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f018fe18-03f2-4871-9231-d18bc06018fc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:39.828317 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f018fe18-03f2-4871-9231-d18bc06018fc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:39.828760 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f018fe18-03f2-4871-9231-d18bc06018fc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:39.829519 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f018fe18-03f2-4871-9231-d18bc06018fc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:39.830616 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f018fe18-03f2-4871-9231-d18bc06018fc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:40.022419 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f018fe18-03f2-4871-9231-d18bc06018fc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:40.031207 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f018fe18-03f2-4871-9231-d18bc06018fc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:40.032688 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f018fe18-03f2-4871-9231-d18bc06018fc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:40.034012 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f018fe18-03f2-4871-9231-d18bc06018fc tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1730 microversion: 2.20 time: 0.217333 Dec 14 10:17:40.034571 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 523/1094] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:39 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1730 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:41.052239 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d5b01af8-adfb-4445-b31d-d3edb28ca1e1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:41.052911 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d5b01af8-adfb-4445-b31d-d3edb28ca1e1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:41.060155 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d5b01af8-adfb-4445-b31d-d3edb28ca1e1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:41.060597 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d5b01af8-adfb-4445-b31d-d3edb28ca1e1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:41.061355 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d5b01af8-adfb-4445-b31d-d3edb28ca1e1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:41.061790 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d5b01af8-adfb-4445-b31d-d3edb28ca1e1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:41.258296 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d5b01af8-adfb-4445-b31d-d3edb28ca1e1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:41.266750 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d5b01af8-adfb-4445-b31d-d3edb28ca1e1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:41.268734 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d5b01af8-adfb-4445-b31d-d3edb28ca1e1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:41.269829 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d5b01af8-adfb-4445-b31d-d3edb28ca1e1 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1730 microversion: 2.20 time: 0.221456 Dec 14 10:17:41.270419 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 572/1095] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:41 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:42.288427 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-fbe159e9-af7a-431d-bcc3-f0e0c291110b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:42.289033 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-fbe159e9-af7a-431d-bcc3-f0e0c291110b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:42.296384 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fbe159e9-af7a-431d-bcc3-f0e0c291110b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:42.296838 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fbe159e9-af7a-431d-bcc3-f0e0c291110b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:42.297598 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fbe159e9-af7a-431d-bcc3-f0e0c291110b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:42.298068 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fbe159e9-af7a-431d-bcc3-f0e0c291110b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:42.576605 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-fbe159e9-af7a-431d-bcc3-f0e0c291110b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:42.585858 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-fbe159e9-af7a-431d-bcc3-f0e0c291110b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:42.587383 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-fbe159e9-af7a-431d-bcc3-f0e0c291110b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:42.588488 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-fbe159e9-af7a-431d-bcc3-f0e0c291110b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1730 microversion: 2.20 time: 0.303766 Dec 14 10:17:42.589039 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 524/1096] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:42 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1730 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:43.567953 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-9884aa4b-2478-4a90-99d2-b3e2755ce331 req-284cce4b-7ac1-4a2c-acc3-2127050f273c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc8d226a-4c08-4a07-94a7-f7c17c509a27", "name": "network-vif-plugged", "status": "completed", "tag": "aa6402ff-8882-4a58-b152-b056853240b9"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:17:43.569837 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:17:43.569837 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:17:43.579190 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-9884aa4b-2478-4a90-99d2-b3e2755ce331 req-284cce4b-7ac1-4a2c-acc3-2127050f273c service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:43.580193 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-9884aa4b-2478-4a90-99d2-b3e2755ce331 req-284cce4b-7ac1-4a2c-acc3-2127050f273c service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:43.595651 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-9884aa4b-2478-4a90-99d2-b3e2755ce331 req-284cce4b-7ac1-4a2c-acc3-2127050f273c service nova] Creating event network-vif-plugged:aa6402ff-8882-4a58-b152-b056853240b9 for instance cc8d226a-4c08-4a07-94a7-f7c17c509a27 on hv-cinder-81888 Dec 14 10:17:43.600871 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-9884aa4b-2478-4a90-99d2-b3e2755ce331 req-284cce4b-7ac1-4a2c-acc3-2127050f273c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037152 Dec 14 10:17:43.601892 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 573/1097] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:17:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:17:43.726661 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-645573f1-b72d-40bc-8af9-0d0791f61030 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:43.727276 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-645573f1-b72d-40bc-8af9-0d0791f61030 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:43.734462 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-645573f1-b72d-40bc-8af9-0d0791f61030 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:43.734909 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-645573f1-b72d-40bc-8af9-0d0791f61030 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:43.735668 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-645573f1-b72d-40bc-8af9-0d0791f61030 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:43.736146 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-645573f1-b72d-40bc-8af9-0d0791f61030 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:43.993565 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-645573f1-b72d-40bc-8af9-0d0791f61030 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:44.002817 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-645573f1-b72d-40bc-8af9-0d0791f61030 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:44.004399 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-645573f1-b72d-40bc-8af9-0d0791f61030 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:44.005599 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-645573f1-b72d-40bc-8af9-0d0791f61030 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1730 microversion: 2.20 time: 0.402233 Dec 14 10:17:44.006255 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 525/1098] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:43 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1730 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:45.024431 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4ef14fc6-b6b2-4d45-9456-0ce472832cff tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:45.025856 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4ef14fc6-b6b2-4d45-9456-0ce472832cff tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:45.034842 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4ef14fc6-b6b2-4d45-9456-0ce472832cff tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:45.035693 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4ef14fc6-b6b2-4d45-9456-0ce472832cff tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:45.036791 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4ef14fc6-b6b2-4d45-9456-0ce472832cff tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:45.037414 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4ef14fc6-b6b2-4d45-9456-0ce472832cff tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:45.346038 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4ef14fc6-b6b2-4d45-9456-0ce472832cff tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:45.354562 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4ef14fc6-b6b2-4d45-9456-0ce472832cff tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:45.356062 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4ef14fc6-b6b2-4d45-9456-0ce472832cff tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:45.357184 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4ef14fc6-b6b2-4d45-9456-0ce472832cff tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1730 microversion: 2.20 time: 0.337159 Dec 14 10:17:45.357786 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 574/1099] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:45 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1730 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:17:46.375224 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-5444ed47-f88a-4bab-9d23-ec7c4b72f136 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:17:46.375761 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-5444ed47-f88a-4bab-9d23-ec7c4b72f136 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:17:46.383192 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5444ed47-f88a-4bab-9d23-ec7c4b72f136 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:46.383641 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5444ed47-f88a-4bab-9d23-ec7c4b72f136 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:46.384408 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5444ed47-f88a-4bab-9d23-ec7c4b72f136 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:17:46.384848 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5444ed47-f88a-4bab-9d23-ec7c4b72f136 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:17:46.580199 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-5444ed47-f88a-4bab-9d23-ec7c4b72f136 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:46.588705 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-5444ed47-f88a-4bab-9d23-ec7c4b72f136 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:46.590245 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-5444ed47-f88a-4bab-9d23-ec7c4b72f136 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:17:46.591371 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-5444ed47-f88a-4bab-9d23-ec7c4b72f136 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1717 microversion: 2.20 time: 0.219932 Dec 14 10:17:46.591932 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 526/1100] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:17:46 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1717 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:18:15.062360 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-216674d2-6ca3-4e41-8934-8a94a2c8f6e4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:15.063265 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-216674d2-6ca3-4e41-8934-8a94a2c8f6e4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:15.071319 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-216674d2-6ca3-4e41-8934-8a94a2c8f6e4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:15.071765 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-216674d2-6ca3-4e41-8934-8a94a2c8f6e4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:15.072532 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-216674d2-6ca3-4e41-8934-8a94a2c8f6e4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:15.072962 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-216674d2-6ca3-4e41-8934-8a94a2c8f6e4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:15.135838 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-216674d2-6ca3-4e41-8934-8a94a2c8f6e4 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.077278 Dec 14 10:18:15.136382 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 575/1101] 10.222.0.20 () {60 vars in 1342 bytes} [Tue Dec 14 10:18:15 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:18:15.230157 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-80a6ab5b-4a47-42dd-b978-ff04d5029f81 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:15.230663 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-80a6ab5b-4a47-42dd-b978-ff04d5029f81 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:15.238319 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-80a6ab5b-4a47-42dd-b978-ff04d5029f81 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:15.238711 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-80a6ab5b-4a47-42dd-b978-ff04d5029f81 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:15.239481 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-80a6ab5b-4a47-42dd-b978-ff04d5029f81 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:15.239920 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-80a6ab5b-4a47-42dd-b978-ff04d5029f81 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:15.299991 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-80a6ab5b-4a47-42dd-b978-ff04d5029f81 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Going to try to terminate instance {{(pid=100985) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:18:15.408598 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-80a6ab5b-4a47-42dd-b978-ff04d5029f81 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 204 len: 0 microversion: 2.20 time: 0.181729 Dec 14 10:18:15.409175 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 527/1102] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Dec 14 10:18:15 2021] DELETE /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 14 10:18:15.417130 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4886c5ab-bac9-49e3-94da-46d785ac91a8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:15.417732 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4886c5ab-bac9-49e3-94da-46d785ac91a8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:15.425753 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4886c5ab-bac9-49e3-94da-46d785ac91a8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:15.426229 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4886c5ab-bac9-49e3-94da-46d785ac91a8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:15.427013 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4886c5ab-bac9-49e3-94da-46d785ac91a8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:15.427428 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4886c5ab-bac9-49e3-94da-46d785ac91a8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:15.732683 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4886c5ab-bac9-49e3-94da-46d785ac91a8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:15.741825 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4886c5ab-bac9-49e3-94da-46d785ac91a8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:15.743347 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4886c5ab-bac9-49e3-94da-46d785ac91a8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:15.744462 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4886c5ab-bac9-49e3-94da-46d785ac91a8 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1723 microversion: 2.20 time: 0.331032 Dec 14 10:18:15.745011 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 576/1103] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:18:15 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:18:16.763273 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f82dcf1d-9d22-46d7-aeef-42e0df37a684 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:16.763969 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f82dcf1d-9d22-46d7-aeef-42e0df37a684 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:16.772320 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f82dcf1d-9d22-46d7-aeef-42e0df37a684 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:16.772785 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f82dcf1d-9d22-46d7-aeef-42e0df37a684 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:16.773546 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f82dcf1d-9d22-46d7-aeef-42e0df37a684 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:16.774002 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f82dcf1d-9d22-46d7-aeef-42e0df37a684 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:17.447287 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f82dcf1d-9d22-46d7-aeef-42e0df37a684 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:17.455848 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f82dcf1d-9d22-46d7-aeef-42e0df37a684 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:17.457336 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f82dcf1d-9d22-46d7-aeef-42e0df37a684 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:17.458491 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f82dcf1d-9d22-46d7-aeef-42e0df37a684 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1723 microversion: 2.20 time: 0.699433 Dec 14 10:18:17.459053 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 528/1104] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:18:16 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1723 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 14 10:18:18.424831 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-9ddae042-7d2a-47a8-ba43-96e6215e3e7a req-e11ecdd5-21ec-4885-b50c-c9a53002bf5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc8d226a-4c08-4a07-94a7-f7c17c509a27", "name": "network-vif-deleted", "tag": "aa6402ff-8882-4a58-b152-b056853240b9"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:18:18.426666 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:18:18.426666 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:18:18.435190 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-9ddae042-7d2a-47a8-ba43-96e6215e3e7a req-e11ecdd5-21ec-4885-b50c-c9a53002bf5f service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:18.435724 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-9ddae042-7d2a-47a8-ba43-96e6215e3e7a req-e11ecdd5-21ec-4885-b50c-c9a53002bf5f service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:18.458134 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-9ddae042-7d2a-47a8-ba43-96e6215e3e7a req-e11ecdd5-21ec-4885-b50c-c9a53002bf5f service nova] Creating event network-vif-deleted:aa6402ff-8882-4a58-b152-b056853240b9 for instance cc8d226a-4c08-4a07-94a7-f7c17c509a27 on hv-cinder-81888 Dec 14 10:18:18.463665 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-9ddae042-7d2a-47a8-ba43-96e6215e3e7a req-e11ecdd5-21ec-4885-b50c-c9a53002bf5f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042735 Dec 14 10:18:18.466179 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 577/1105] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:18:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:18:18.479076 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-b171295d-8787-4392-ab4c-4c6eb5791172 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:18.479994 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-b171295d-8787-4392-ab4c-4c6eb5791172 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:18.489101 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b171295d-8787-4392-ab4c-4c6eb5791172 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:18.490319 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b171295d-8787-4392-ab4c-4c6eb5791172 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:18.491347 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b171295d-8787-4392-ab4c-4c6eb5791172 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:18.491996 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-b171295d-8787-4392-ab4c-4c6eb5791172 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:18.648662 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-b171295d-8787-4392-ab4c-4c6eb5791172 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:18.661018 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-b171295d-8787-4392-ab4c-4c6eb5791172 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:18.662757 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-b171295d-8787-4392-ab4c-4c6eb5791172 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f659954c79f3426aaaf6612c48a84f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2622fa7624094bfe5a81b02f1bcdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:18.664071 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-b171295d-8787-4392-ab4c-4c6eb5791172 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 200 len: 1366 microversion: 2.20 time: 0.189258 Dec 14 10:18:18.664929 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 529/1106] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:18:18 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 14 10:18:19.683253 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-54e63f90-155e-44af-b92d-099606483626 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:19.683939 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-54e63f90-155e-44af-b92d-099606483626 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:19.691798 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-54e63f90-155e-44af-b92d-099606483626 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:19.692236 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-54e63f90-155e-44af-b92d-099606483626 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:19.692997 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-54e63f90-155e-44af-b92d-099606483626 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:19.693419 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-54e63f90-155e-44af-b92d-099606483626 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:19.744124 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-54e63f90-155e-44af-b92d-099606483626 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] HTTP exception thrown: Instance cc8d226a-4c08-4a07-94a7-f7c17c509a27 could not be found. Dec 14 10:18:19.744709 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-54e63f90-155e-44af-b92d-099606483626 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Returning 404 to user: Instance cc8d226a-4c08-4a07-94a7-f7c17c509a27 could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:18:19.745512 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-54e63f90-155e-44af-b92d-099606483626 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 404 len: 111 microversion: 2.20 time: 0.066486 Dec 14 10:18:19.746296 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 578/1107] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:18:19 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 14 10:18:19.754752 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-be34399c-5c28-4e6d-b41d-499995b4526b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '.version_select at 0x7fb1799a04c0>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:19.773448 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-be34399c-5c28-4e6d-b41d-499995b4526b tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1202415904" status: 204 len: 0 microversion: 2.20 time: 0.022556 Dec 14 10:18:19.774710 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 530/1108] 10.222.0.20 () {60 vars in 1261 bytes} [Tue Dec 14 10:18:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1202415904 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 14 10:18:22.076665 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-152cb6b2-aff4-4b73-a5fd-cd3641bc3361 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:22.077140 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-152cb6b2-aff4-4b73-a5fd-cd3641bc3361 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:22.085409 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-152cb6b2-aff4-4b73-a5fd-cd3641bc3361 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:22.085864 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-152cb6b2-aff4-4b73-a5fd-cd3641bc3361 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:22.086652 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-152cb6b2-aff4-4b73-a5fd-cd3641bc3361 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:22.087086 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-152cb6b2-aff4-4b73-a5fd-cd3641bc3361 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:22.138366 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-152cb6b2-aff4-4b73-a5fd-cd3641bc3361 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] HTTP exception thrown: Instance cc8d226a-4c08-4a07-94a7-f7c17c509a27 could not be found. Dec 14 10:18:22.138963 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-152cb6b2-aff4-4b73-a5fd-cd3641bc3361 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Returning 404 to user: Instance cc8d226a-4c08-4a07-94a7-f7c17c509a27 could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:18:22.139788 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-152cb6b2-aff4-4b73-a5fd-cd3641bc3361 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 404 len: 111 microversion: 2.20 time: 0.066792 Dec 14 10:18:22.140616 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 579/1109] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Dec 14 10:18:22 2021] DELETE /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 14 10:18:22.149311 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-4269b71b-c1e1-4d51-81cd-d8ba6aa0e486 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:22.149917 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-4269b71b-c1e1-4d51-81cd-d8ba6aa0e486 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: cc8d226a-4c08-4a07-94a7-f7c17c509a27] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:22.157311 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4269b71b-c1e1-4d51-81cd-d8ba6aa0e486 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:22.157750 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4269b71b-c1e1-4d51-81cd-d8ba6aa0e486 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:22.158576 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4269b71b-c1e1-4d51-81cd-d8ba6aa0e486 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:22.159112 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-4269b71b-c1e1-4d51-81cd-d8ba6aa0e486 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:22.211682 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-4269b71b-c1e1-4d51-81cd-d8ba6aa0e486 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] HTTP exception thrown: Instance cc8d226a-4c08-4a07-94a7-f7c17c509a27 could not be found. Dec 14 10:18:22.212264 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-4269b71b-c1e1-4d51-81cd-d8ba6aa0e486 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Returning 404 to user: Instance cc8d226a-4c08-4a07-94a7-f7c17c509a27 could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:18:22.213063 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-4269b71b-c1e1-4d51-81cd-d8ba6aa0e486 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27" status: 404 len: 111 microversion: 2.20 time: 0.067410 Dec 14 10:18:22.213703 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 531/1110] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:18:22 2021] GET /compute/v2.1/servers/cc8d226a-4c08-4a07-94a7-f7c17c509a27 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 14 10:18:23.439141 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-cc470d3a-387e-4041-89bc-5abaa5572178 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:23.439640 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-cc470d3a-387e-4041-89bc-5abaa5572178 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:23.446888 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cc470d3a-387e-4041-89bc-5abaa5572178 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:23.447331 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cc470d3a-387e-4041-89bc-5abaa5572178 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:23.448097 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cc470d3a-387e-4041-89bc-5abaa5572178 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:23.448522 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-cc470d3a-387e-4041-89bc-5abaa5572178 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:23.497395 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-cc470d3a-387e-4041-89bc-5abaa5572178 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] HTTP exception thrown: Instance 457d8e04-7e43-4287-8640-efedad40515d could not be found. Dec 14 10:18:23.497999 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-cc470d3a-387e-4041-89bc-5abaa5572178 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Returning 404 to user: Instance 457d8e04-7e43-4287-8640-efedad40515d could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:18:23.498813 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-cc470d3a-387e-4041-89bc-5abaa5572178 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "DELETE /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 404 len: 111 microversion: 2.20 time: 0.063354 Dec 14 10:18:23.499345 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 580/1111] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Dec 14 10:18:23 2021] DELETE /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 14 10:18:23.507425 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-cc5c75a8-9c42-4b43-ae55-31a0d094eb44 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:23.508027 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-cc5c75a8-9c42-4b43-ae55-31a0d094eb44 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] [instance: 457d8e04-7e43-4287-8640-efedad40515d] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:23.515134 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cc5c75a8-9c42-4b43-ae55-31a0d094eb44 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:23.515575 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cc5c75a8-9c42-4b43-ae55-31a0d094eb44 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:23.516329 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cc5c75a8-9c42-4b43-ae55-31a0d094eb44 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:23.516754 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-cc5c75a8-9c42-4b43-ae55-31a0d094eb44 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:23.569254 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-cc5c75a8-9c42-4b43-ae55-31a0d094eb44 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] HTTP exception thrown: Instance 457d8e04-7e43-4287-8640-efedad40515d could not be found. Dec 14 10:18:23.569832 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-cc5c75a8-9c42-4b43-ae55-31a0d094eb44 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] Returning 404 to user: Instance 457d8e04-7e43-4287-8640-efedad40515d could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:18:23.570657 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-cc5c75a8-9c42-4b43-ae55-31a0d094eb44 tempest-AttachVolumeShelveTestJSON-961516669 tempest-AttachVolumeShelveTestJSON-961516669-project] 10.222.0.20 "GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d" status: 404 len: 111 microversion: 2.20 time: 0.066932 Dec 14 10:18:23.571182 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 532/1112] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Dec 14 10:18:23 2021] GET /compute/v2.1/servers/457d8e04-7e43-4287-8640-efedad40515d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 14 10:18:29.960410 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-3a24f7ac-44e1-436d-93f8-dd4f7f8f9dc4 tempest-VolumesGetTestJSON-1312972995 tempest-VolumesGetTestJSON-1312972995-project] Action: 'create', calling method: .version_select at 0x7fb179307e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-115084525", "metadata": {"Type": "work"}}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:18:30.399938 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-3a24f7ac-44e1-436d-93f8-dd4f7f8f9dc4 tempest-VolumesGetTestJSON-1312972995 tempest-VolumesGetTestJSON-1312972995-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.588168 Dec 14 10:18:30.400547 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 581/1113] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Dec 14 10:18:29 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 589 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 14 10:18:30.412407 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a1d065e1-b53c-4f16-84ad-0429076c6d4c tempest-VolumesGetTestJSON-1312972995 tempest-VolumesGetTestJSON-1312972995-project] Calling method '.version_select at 0x7fb1799a0940>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:30.491083 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a1d065e1-b53c-4f16-84ad-0429076c6d4c tempest-VolumesGetTestJSON-1312972995 tempest-VolumesGetTestJSON-1312972995-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f2ac93b0-815c-47d8-b646-fe6b9b3317b5" status: 200 len: 352 microversion: 2.1 time: 0.083136 Dec 14 10:18:30.491641 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 533/1114] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Dec 14 10:18:30 2021] GET /compute/v2.1/os-volumes/f2ac93b0-815c-47d8-b646-fe6b9b3317b5 => generated 352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:18:31.503594 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-212082dd-c523-4286-897b-57406b68ab33 tempest-VolumesGetTestJSON-1312972995 tempest-VolumesGetTestJSON-1312972995-project] Calling method '.version_select at 0x7fb1791de310>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:31.579938 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-212082dd-c523-4286-897b-57406b68ab33 tempest-VolumesGetTestJSON-1312972995 tempest-VolumesGetTestJSON-1312972995-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f2ac93b0-815c-47d8-b646-fe6b9b3317b5" status: 200 len: 353 microversion: 2.1 time: 0.080106 Dec 14 10:18:31.580499 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 582/1115] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Dec 14 10:18:31 2021] GET /compute/v2.1/os-volumes/f2ac93b0-815c-47d8-b646-fe6b9b3317b5 => generated 353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:18:31.591078 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-ef7c7ef7-d624-43a1-81fa-c0de11cf71ce tempest-VolumesGetTestJSON-1312972995 tempest-VolumesGetTestJSON-1312972995-project] Calling method '.version_select at 0x7fb17af84af0>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:31.668407 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-ef7c7ef7-d624-43a1-81fa-c0de11cf71ce tempest-VolumesGetTestJSON-1312972995 tempest-VolumesGetTestJSON-1312972995-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f2ac93b0-815c-47d8-b646-fe6b9b3317b5" status: 200 len: 353 microversion: 2.1 time: 0.080878 Dec 14 10:18:31.668952 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 534/1116] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Dec 14 10:18:31 2021] GET /compute/v2.1/os-volumes/f2ac93b0-815c-47d8-b646-fe6b9b3317b5 => generated 353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:18:31.684969 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-bbfb65e3-7b8a-40f5-af4a-1463e35d7c47 tempest-VolumesGetTestJSON-1312972995 tempest-VolumesGetTestJSON-1312972995-project] Calling method '.version_select at 0x7fb17938b280>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:31.775984 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-bbfb65e3-7b8a-40f5-af4a-1463e35d7c47 tempest-VolumesGetTestJSON-1312972995 tempest-VolumesGetTestJSON-1312972995-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/f2ac93b0-815c-47d8-b646-fe6b9b3317b5" status: 202 len: 0 microversion: 2.1 time: 0.094496 Dec 14 10:18:31.776578 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 583/1117] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Dec 14 10:18:31 2021] DELETE /compute/v2.1/os-volumes/f2ac93b0-815c-47d8-b646-fe6b9b3317b5 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:18:31.785829 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-55267d87-4dc5-4991-a905-eeea57cbf671 tempest-VolumesGetTestJSON-1312972995 tempest-VolumesGetTestJSON-1312972995-project] Calling method '.version_select at 0x7fb179aac0d0>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:31.868968 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-55267d87-4dc5-4991-a905-eeea57cbf671 tempest-VolumesGetTestJSON-1312972995 tempest-VolumesGetTestJSON-1312972995-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f2ac93b0-815c-47d8-b646-fe6b9b3317b5" status: 200 len: 352 microversion: 2.1 time: 0.087677 Dec 14 10:18:31.869518 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 535/1118] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Dec 14 10:18:31 2021] GET /compute/v2.1/os-volumes/f2ac93b0-815c-47d8-b646-fe6b9b3317b5 => generated 352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:18:32.881079 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8f680788-d803-4749-9a67-b9e1198b6f97 tempest-VolumesGetTestJSON-1312972995 tempest-VolumesGetTestJSON-1312972995-project] Calling method '.version_select at 0x7fb17938bdc0>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:32.938611 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-8f680788-d803-4749-9a67-b9e1198b6f97 tempest-VolumesGetTestJSON-1312972995 tempest-VolumesGetTestJSON-1312972995-project] HTTP exception thrown: Volume f2ac93b0-815c-47d8-b646-fe6b9b3317b5 could not be found. Dec 14 10:18:32.939776 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8f680788-d803-4749-9a67-b9e1198b6f97 tempest-VolumesGetTestJSON-1312972995 tempest-VolumesGetTestJSON-1312972995-project] Returning 404 to user: Volume f2ac93b0-815c-47d8-b646-fe6b9b3317b5 could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:18:32.940732 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8f680788-d803-4749-9a67-b9e1198b6f97 tempest-VolumesGetTestJSON-1312972995 tempest-VolumesGetTestJSON-1312972995-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f2ac93b0-815c-47d8-b646-fe6b9b3317b5" status: 404 len: 109 microversion: 2.1 time: 0.063891 Dec 14 10:18:32.941296 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 584/1119] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Dec 14 10:18:32 2021] GET /compute/v2.1/os-volumes/f2ac93b0-815c-47d8-b646-fe6b9b3317b5 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:18:44.378224 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-13457a1d-2116-46e3-a080-80c7d7b14447 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-452116336", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-621328310", "security_groups": [{"name": "tempest-secgroup-smoke-442028405"}], "block_device_mapping_v2": [{"uuid": "d467082f-08a0-4d6f-aee7-11039f426eeb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bd1cbab0-8707-4ef3-99d9-9624dbe62aa4"}]}} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:18:44.525999 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.network.neutron [None req-13457a1d-2116-46e3-a080-80c7d7b14447 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] validate_networks() for [('bd1cbab0-8707-4ef3-99d9-9624dbe62aa4', None, None, None)] {{(pid=100985) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:18:45.100324 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-13457a1d-2116-46e3-a080-80c7d7b14447 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Flavor limits 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:18:45.101005 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-13457a1d-2116-46e3-a080-80c7d7b14447 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Image limits 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:18:45.101484 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-13457a1d-2116-46e3-a080-80c7d7b14447 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Flavor pref 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:18:45.101897 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-13457a1d-2116-46e3-a080-80c7d7b14447 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Image pref 0:0:0 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:18:45.102345 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.virt.hardware [None req-13457a1d-2116-46e3-a080-80c7d7b14447 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:18:45.110578 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-13457a1d-2116-46e3-a080-80c7d7b14447 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:45.111025 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-13457a1d-2116-46e3-a080-80c7d7b14447 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:45.111819 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-13457a1d-2116-46e3-a080-80c7d7b14447 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:45.112251 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-13457a1d-2116-46e3-a080-80c7d7b14447 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:45.130210 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-13457a1d-2116-46e3-a080-80c7d7b14447 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Getting quotas for project 1381b4c2d5654dc2bf924671ef0ec4a3. Resources: {'cores', 'instances', 'ram'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:18:45.134102 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.quota [None req-13457a1d-2116-46e3-a080-80c7d7b14447 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Getting quotas for user e9766e50607147dbad279b733d671264 and project 1381b4c2d5654dc2bf924671ef0ec4a3. Resources: {'cores', 'instances', 'ram'} {{(pid=100985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:18:45.222923 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-13457a1d-2116-46e3-a080-80c7d7b14447 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Going to run 1 instances... {{(pid=100985) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:18:45.224997 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-13457a1d-2116-46e3-a080-80c7d7b14447 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d467082f-08a0-4d6f-aee7-11039f426eeb',volume_size=None,volume_type=None)] {{(pid=100985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:18:45.385724 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-13457a1d-2116-46e3-a080-80c7d7b14447 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.011846 Dec 14 10:18:45.386444 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 536/1120] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Dec 14 10:18:44 2021] POST /compute/v2.1/servers => generated 405 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 10:18:45.396273 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-48dc54da-0add-48b1-a4c4-e41bb22f5490 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:45.396874 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-48dc54da-0add-48b1-a4c4-e41bb22f5490 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:45.467597 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-48dc54da-0add-48b1-a4c4-e41bb22f5490 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:45.475798 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-48dc54da-0add-48b1-a4c4-e41bb22f5490 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 200 len: 1093 microversion: 2.1 time: 0.083189 Dec 14 10:18:45.476446 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 585/1121] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:18:45 2021] GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 1093 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:18:46.494639 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-5597ba21-efe0-48b8-a6d8-ec633bebb302 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:46.495695 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-5597ba21-efe0-48b8-a6d8-ec633bebb302 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:46.505539 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5597ba21-efe0-48b8-a6d8-ec633bebb302 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:46.506412 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5597ba21-efe0-48b8-a6d8-ec633bebb302 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:46.507257 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5597ba21-efe0-48b8-a6d8-ec633bebb302 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:46.507699 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5597ba21-efe0-48b8-a6d8-ec633bebb302 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:46.649080 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-5597ba21-efe0-48b8-a6d8-ec633bebb302 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:46.658166 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-5597ba21-efe0-48b8-a6d8-ec633bebb302 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 200 len: 1209 microversion: 2.1 time: 0.168389 Dec 14 10:18:46.659064 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 537/1122] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:18:46 2021] GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 1209 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:18:47.678316 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-fb1ff02f-ba09-4def-b470-caaa753ef962 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:47.679471 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-fb1ff02f-ba09-4def-b470-caaa753ef962 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:47.687470 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fb1ff02f-ba09-4def-b470-caaa753ef962 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:47.690360 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fb1ff02f-ba09-4def-b470-caaa753ef962 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:47.691253 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fb1ff02f-ba09-4def-b470-caaa753ef962 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:47.691861 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fb1ff02f-ba09-4def-b470-caaa753ef962 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:47.993851 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-fb1ff02f-ba09-4def-b470-caaa753ef962 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:48.006238 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-fb1ff02f-ba09-4def-b470-caaa753ef962 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 200 len: 1264 microversion: 2.1 time: 0.334432 Dec 14 10:18:48.007149 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 586/1123] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:18:47 2021] GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 1264 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:18:48.423392 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-f5c85e77-3d2e-4bc2-ba09-2179b7075cdd req-1f5081b8-a9b0-44a0-9c57-7ce52e432c94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a460f6af-ea8f-4919-a434-d18f79e91fd6", "tag": "a75e5b84-f235-4d33-9d34-15a4fbd8cb85"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:18:48.425871 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:18:48.425871 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:18:48.440858 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-f5c85e77-3d2e-4bc2-ba09-2179b7075cdd req-1f5081b8-a9b0-44a0-9c57-7ce52e432c94 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:48.441304 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-f5c85e77-3d2e-4bc2-ba09-2179b7075cdd req-1f5081b8-a9b0-44a0-9c57-7ce52e432c94 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:48.462177 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-f5c85e77-3d2e-4bc2-ba09-2179b7075cdd req-1f5081b8-a9b0-44a0-9c57-7ce52e432c94 service nova] Creating event network-changed:a75e5b84-f235-4d33-9d34-15a4fbd8cb85 for instance a460f6af-ea8f-4919-a434-d18f79e91fd6 on hv-cinder-81888 Dec 14 10:18:48.467328 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-f5c85e77-3d2e-4bc2-ba09-2179b7075cdd req-1f5081b8-a9b0-44a0-9c57-7ce52e432c94 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048166 Dec 14 10:18:48.467921 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 538/1124] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:18:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:18:49.023329 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-b508f75f-41d5-43cf-9f9b-1fda88f35190 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:49.023976 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-b508f75f-41d5-43cf-9f9b-1fda88f35190 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:49.033872 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b508f75f-41d5-43cf-9f9b-1fda88f35190 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:49.034487 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b508f75f-41d5-43cf-9f9b-1fda88f35190 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:49.035257 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b508f75f-41d5-43cf-9f9b-1fda88f35190 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:49.035879 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b508f75f-41d5-43cf-9f9b-1fda88f35190 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:49.252860 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-b508f75f-41d5-43cf-9f9b-1fda88f35190 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:49.261512 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-b508f75f-41d5-43cf-9f9b-1fda88f35190 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 200 len: 1264 microversion: 2.1 time: 0.241985 Dec 14 10:18:49.271384 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 587/1125] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:18:49 2021] GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 1264 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:18:50.279599 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-2a394f31-b6d3-45d6-aa25-c259c846c732 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:50.280296 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-2a394f31-b6d3-45d6-aa25-c259c846c732 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:50.288380 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2a394f31-b6d3-45d6-aa25-c259c846c732 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:50.288824 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2a394f31-b6d3-45d6-aa25-c259c846c732 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:50.289593 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2a394f31-b6d3-45d6-aa25-c259c846c732 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:50.290051 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2a394f31-b6d3-45d6-aa25-c259c846c732 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:50.505187 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-2a394f31-b6d3-45d6-aa25-c259c846c732 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:50.513458 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-2a394f31-b6d3-45d6-aa25-c259c846c732 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 200 len: 1264 microversion: 2.1 time: 0.238226 Dec 14 10:18:50.514029 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 539/1126] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:18:50 2021] GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 1264 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:18:51.530393 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-1f8bcdd0-af14-4219-8f0b-8d01589afc51 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:51.531011 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-1f8bcdd0-af14-4219-8f0b-8d01589afc51 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:51.538461 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1f8bcdd0-af14-4219-8f0b-8d01589afc51 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:51.538902 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1f8bcdd0-af14-4219-8f0b-8d01589afc51 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:51.539655 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1f8bcdd0-af14-4219-8f0b-8d01589afc51 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:51.540085 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-1f8bcdd0-af14-4219-8f0b-8d01589afc51 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:51.732033 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-1f8bcdd0-af14-4219-8f0b-8d01589afc51 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:51.741041 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-1f8bcdd0-af14-4219-8f0b-8d01589afc51 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 200 len: 1264 microversion: 2.1 time: 0.214562 Dec 14 10:18:51.741601 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 588/1127] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:18:51 2021] GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:18:52.757928 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-8069ae42-aa63-4d57-96fa-8131419012d3 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:52.758570 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-8069ae42-aa63-4d57-96fa-8131419012d3 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:52.765663 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8069ae42-aa63-4d57-96fa-8131419012d3 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:52.766152 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8069ae42-aa63-4d57-96fa-8131419012d3 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:52.767576 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8069ae42-aa63-4d57-96fa-8131419012d3 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:52.768131 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8069ae42-aa63-4d57-96fa-8131419012d3 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:52.968078 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-8069ae42-aa63-4d57-96fa-8131419012d3 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:52.976428 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-8069ae42-aa63-4d57-96fa-8131419012d3 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 200 len: 1264 microversion: 2.1 time: 0.222203 Dec 14 10:18:52.977193 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 540/1128] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:18:52 2021] GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 1264 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:18:53.993021 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-8e05c535-d2ba-4936-a22a-bdb72766c997 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:53.993631 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-8e05c535-d2ba-4936-a22a-bdb72766c997 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:54.002554 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8e05c535-d2ba-4936-a22a-bdb72766c997 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:54.003004 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8e05c535-d2ba-4936-a22a-bdb72766c997 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:54.003863 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8e05c535-d2ba-4936-a22a-bdb72766c997 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:54.004296 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-8e05c535-d2ba-4936-a22a-bdb72766c997 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:54.208282 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-8e05c535-d2ba-4936-a22a-bdb72766c997 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:54.216221 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-8e05c535-d2ba-4936-a22a-bdb72766c997 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 200 len: 1264 microversion: 2.1 time: 0.226774 Dec 14 10:18:54.216814 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 589/1129] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:18:53 2021] GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:18:55.231504 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: ERROR oslo.messaging._drivers.impl_rabbit [-] [877fdd64-74ed-4152-a202-411db76c1c99] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 14 10:18:55.235054 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-305bbe93-0a4e-460c-bacb-895753a00cba tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:55.236428 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-305bbe93-0a4e-460c-bacb-895753a00cba tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:55.243595 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-305bbe93-0a4e-460c-bacb-895753a00cba tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:55.244069 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-305bbe93-0a4e-460c-bacb-895753a00cba tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:55.244835 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-305bbe93-0a4e-460c-bacb-895753a00cba tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:55.245265 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-305bbe93-0a4e-460c-bacb-895753a00cba tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:55.442750 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-305bbe93-0a4e-460c-bacb-895753a00cba tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:55.450707 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-305bbe93-0a4e-460c-bacb-895753a00cba tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 200 len: 1264 microversion: 2.1 time: 0.220679 Dec 14 10:18:55.451265 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 541/1130] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:18:55 2021] GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:18:56.467130 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-d7c02a01-9d51-417b-ae5f-7299396d22aa tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:56.467726 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-d7c02a01-9d51-417b-ae5f-7299396d22aa tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:56.473173 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dbc6cbdf-0202-4239-bd6f-4fd7a388aeff] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 14 10:18:56.476043 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d7c02a01-9d51-417b-ae5f-7299396d22aa tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:56.476480 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d7c02a01-9d51-417b-ae5f-7299396d22aa tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:56.477227 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d7c02a01-9d51-417b-ae5f-7299396d22aa tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:56.477650 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-d7c02a01-9d51-417b-ae5f-7299396d22aa tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:56.811715 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-d7c02a01-9d51-417b-ae5f-7299396d22aa tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:56.820420 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-d7c02a01-9d51-417b-ae5f-7299396d22aa tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 200 len: 1264 microversion: 2.1 time: 0.357015 Dec 14 10:18:56.820980 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 590/1131] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:18:56 2021] GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 1264 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:18:57.838660 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-60beba1f-41da-4c00-9ca7-8fd56bf4cb97 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:57.839368 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-60beba1f-41da-4c00-9ca7-8fd56bf4cb97 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:57.857769 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-60beba1f-41da-4c00-9ca7-8fd56bf4cb97 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:57.858276 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-60beba1f-41da-4c00-9ca7-8fd56bf4cb97 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:57.859070 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-60beba1f-41da-4c00-9ca7-8fd56bf4cb97 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:57.859513 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-60beba1f-41da-4c00-9ca7-8fd56bf4cb97 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:57.900118 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO oslo.messaging._drivers.impl_rabbit [-] [877fdd64-74ed-4152-a202-411db76c1c99] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50732. Dec 14 10:18:58.096757 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-60beba1f-41da-4c00-9ca7-8fd56bf4cb97 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:58.105194 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-60beba1f-41da-4c00-9ca7-8fd56bf4cb97 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 200 len: 1264 microversion: 2.1 time: 0.270205 Dec 14 10:18:58.105762 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 542/1132] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:18:57 2021] GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 1264 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:18:59.122371 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-40ea26f4-8d9f-4c2e-abff-fb7d477a83fd tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:18:59.122922 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-40ea26f4-8d9f-4c2e-abff-fb7d477a83fd tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:18:59.141058 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-40ea26f4-8d9f-4c2e-abff-fb7d477a83fd tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:59.142082 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-40ea26f4-8d9f-4c2e-abff-fb7d477a83fd tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:59.142849 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-40ea26f4-8d9f-4c2e-abff-fb7d477a83fd tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:18:59.143277 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-40ea26f4-8d9f-4c2e-abff-fb7d477a83fd tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:18:59.194744 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO oslo.messaging._drivers.impl_rabbit [-] [dbc6cbdf-0202-4239-bd6f-4fd7a388aeff] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50742. Dec 14 10:18:59.345050 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-40ea26f4-8d9f-4c2e-abff-fb7d477a83fd tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:18:59.353184 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-40ea26f4-8d9f-4c2e-abff-fb7d477a83fd tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 200 len: 1264 microversion: 2.1 time: 0.234459 Dec 14 10:18:59.353733 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 591/1133] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:18:59 2021] GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:00.025754 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-deb39c7c-b0b4-459a-9af5-f281fb4e0453 req-d04420f7-18a1-4d6b-a296-66561a28a5fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a460f6af-ea8f-4919-a434-d18f79e91fd6", "name": "network-vif-plugged", "status": "completed", "tag": "a75e5b84-f235-4d33-9d34-15a4fbd8cb85"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:19:00.027700 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:19:00.027700 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:19:00.037315 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-deb39c7c-b0b4-459a-9af5-f281fb4e0453 req-d04420f7-18a1-4d6b-a296-66561a28a5fb service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:00.037765 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-deb39c7c-b0b4-459a-9af5-f281fb4e0453 req-d04420f7-18a1-4d6b-a296-66561a28a5fb service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:00.054082 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-deb39c7c-b0b4-459a-9af5-f281fb4e0453 req-d04420f7-18a1-4d6b-a296-66561a28a5fb service nova] Creating event network-vif-plugged:a75e5b84-f235-4d33-9d34-15a4fbd8cb85 for instance a460f6af-ea8f-4919-a434-d18f79e91fd6 on hv-cinder-81888 Dec 14 10:19:00.058931 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-deb39c7c-b0b4-459a-9af5-f281fb4e0453 req-d04420f7-18a1-4d6b-a296-66561a28a5fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037164 Dec 14 10:19:00.059687 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 543/1134] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:19:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:19:00.370217 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-dfea9256-c4b6-4368-9e0b-9d16cfe3e838 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:00.370832 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-dfea9256-c4b6-4368-9e0b-9d16cfe3e838 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:00.378622 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dfea9256-c4b6-4368-9e0b-9d16cfe3e838 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:00.379064 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dfea9256-c4b6-4368-9e0b-9d16cfe3e838 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:00.379829 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dfea9256-c4b6-4368-9e0b-9d16cfe3e838 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:00.380258 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-dfea9256-c4b6-4368-9e0b-9d16cfe3e838 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:00.574686 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-dfea9256-c4b6-4368-9e0b-9d16cfe3e838 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:00.582717 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-dfea9256-c4b6-4368-9e0b-9d16cfe3e838 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 200 len: 1264 microversion: 2.1 time: 0.216080 Dec 14 10:19:00.583212 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 592/1135] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:00 2021] GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 1264 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:01.599982 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-f75357ec-47c7-4c80-bd10-ca682d525896 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:01.600605 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-f75357ec-47c7-4c80-bd10-ca682d525896 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:01.607971 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f75357ec-47c7-4c80-bd10-ca682d525896 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:01.608413 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f75357ec-47c7-4c80-bd10-ca682d525896 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:01.609178 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f75357ec-47c7-4c80-bd10-ca682d525896 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:01.609607 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-f75357ec-47c7-4c80-bd10-ca682d525896 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:01.802719 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-f75357ec-47c7-4c80-bd10-ca682d525896 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:01.810748 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-f75357ec-47c7-4c80-bd10-ca682d525896 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 200 len: 1451 microversion: 2.1 time: 0.215085 Dec 14 10:19:01.811304 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 544/1136] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:01 2021] GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 1451 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:01.826383 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-25a59205-e3b6-4e5b-9ae9-932287860a23 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:01.826992 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-25a59205-e3b6-4e5b-9ae9-932287860a23 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:01.834171 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-25a59205-e3b6-4e5b-9ae9-932287860a23 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:01.834617 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-25a59205-e3b6-4e5b-9ae9-932287860a23 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:01.835373 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-25a59205-e3b6-4e5b-9ae9-932287860a23 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:01.835798 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-25a59205-e3b6-4e5b-9ae9-932287860a23 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:02.030178 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-25a59205-e3b6-4e5b-9ae9-932287860a23 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:02.039229 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-25a59205-e3b6-4e5b-9ae9-932287860a23 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 200 len: 1451 microversion: 2.1 time: 0.216422 Dec 14 10:19:02.039787 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 593/1137] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:01 2021] GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 1451 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:04.835204 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-b3f1b407-9505-4543-8869-16d7186c5261 req-90365726-f18d-4bad-bedb-80f3f5a9add9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a460f6af-ea8f-4919-a434-d18f79e91fd6", "tag": "a75e5b84-f235-4d33-9d34-15a4fbd8cb85"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:19:04.836759 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:19:04.836759 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:19:04.845277 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-b3f1b407-9505-4543-8869-16d7186c5261 req-90365726-f18d-4bad-bedb-80f3f5a9add9 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:04.846123 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-b3f1b407-9505-4543-8869-16d7186c5261 req-90365726-f18d-4bad-bedb-80f3f5a9add9 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:04.863640 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-b3f1b407-9505-4543-8869-16d7186c5261 req-90365726-f18d-4bad-bedb-80f3f5a9add9 service nova] Creating event network-changed:a75e5b84-f235-4d33-9d34-15a4fbd8cb85 for instance a460f6af-ea8f-4919-a434-d18f79e91fd6 on hv-cinder-81888 Dec 14 10:19:04.868676 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-b3f1b407-9505-4543-8869-16d7186c5261 req-90365726-f18d-4bad-bedb-80f3f5a9add9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.265222 Dec 14 10:19:04.869231 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 545/1138] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:19:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:19:07.927054 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4667aa17-635b-47d9-9cc9-777fa4e904b1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-533713335", "imageRef": "5be36fdc-2baa-4efd-b830-5a5c3fd7beba", "flavorRef": "452", "networks": [{"uuid": "23855567-e612-4fa6-957a-5f2beab24937"}]}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:19:07.991770 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.network.neutron [None req-4667aa17-635b-47d9-9cc9-777fa4e904b1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] validate_networks() for [('23855567-e612-4fa6-957a-5f2beab24937', None, None, None)] {{(pid=100984) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:19:08.494482 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-4667aa17-635b-47d9-9cc9-777fa4e904b1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Flavor limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:19:08.494901 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-4667aa17-635b-47d9-9cc9-777fa4e904b1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Image limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:19:08.495367 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-4667aa17-635b-47d9-9cc9-777fa4e904b1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Flavor pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:19:08.495801 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-4667aa17-635b-47d9-9cc9-777fa4e904b1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Image pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:19:08.496202 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-4667aa17-635b-47d9-9cc9-777fa4e904b1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:19:08.504960 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4667aa17-635b-47d9-9cc9-777fa4e904b1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:08.505401 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4667aa17-635b-47d9-9cc9-777fa4e904b1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:08.506235 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4667aa17-635b-47d9-9cc9-777fa4e904b1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:08.506670 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4667aa17-635b-47d9-9cc9-777fa4e904b1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:08.523443 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-4667aa17-635b-47d9-9cc9-777fa4e904b1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Getting quotas for project 51c3d9486e5240b49749f90b95d2e3d1. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:19:08.527298 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-4667aa17-635b-47d9-9cc9-777fa4e904b1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Getting quotas for user 81b2242fde814a65966d5f6372d33a2d and project 51c3d9486e5240b49749f90b95d2e3d1. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:19:08.538290 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4667aa17-635b-47d9-9cc9-777fa4e904b1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Going to run 1 instances... {{(pid=100984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:19:08.540496 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4667aa17-635b-47d9-9cc9-777fa4e904b1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: 3555bb79-153c-4a3f-8518-00ae09fe5463] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5be36fdc-2baa-4efd-b830-5a5c3fd7beba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:19:08.584604 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4667aa17-635b-47d9-9cc9-777fa4e904b1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661139 Dec 14 10:19:08.585229 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 594/1139] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Dec 14 10:19:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 10:19:08.596101 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-4d73d83e-e789-4e30-9caf-b1dd1ad9d5eb tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:08.596794 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-4d73d83e-e789-4e30-9caf-b1dd1ad9d5eb tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: 3555bb79-153c-4a3f-8518-00ae09fe5463] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:08.668216 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-4d73d83e-e789-4e30-9caf-b1dd1ad9d5eb tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:08.676786 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-4d73d83e-e789-4e30-9caf-b1dd1ad9d5eb tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463" status: 200 len: 1213 microversion: 2.1 time: 0.085233 Dec 14 10:19:08.677356 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 546/1140] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:08 2021] GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:09.695051 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-0f89a787-9918-48d4-9727-d72f8e9df051 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:09.695664 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-0f89a787-9918-48d4-9727-d72f8e9df051 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: 3555bb79-153c-4a3f-8518-00ae09fe5463] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:09.705075 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0f89a787-9918-48d4-9727-d72f8e9df051 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:09.705515 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0f89a787-9918-48d4-9727-d72f8e9df051 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:09.706660 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0f89a787-9918-48d4-9727-d72f8e9df051 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:09.707350 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0f89a787-9918-48d4-9727-d72f8e9df051 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:09.827420 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-0f89a787-9918-48d4-9727-d72f8e9df051 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:09.837374 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-0f89a787-9918-48d4-9727-d72f8e9df051 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463" status: 200 len: 1273 microversion: 2.1 time: 0.147735 Dec 14 10:19:09.838113 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 595/1141] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:09 2021] GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463 => generated 1273 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:19:10.853969 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-fe090902-040c-405c-9bbb-faa8b7133050 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:10.854621 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-fe090902-040c-405c-9bbb-faa8b7133050 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: 3555bb79-153c-4a3f-8518-00ae09fe5463] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:10.863198 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fe090902-040c-405c-9bbb-faa8b7133050 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:10.863643 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fe090902-040c-405c-9bbb-faa8b7133050 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:10.864408 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fe090902-040c-405c-9bbb-faa8b7133050 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:10.864869 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-fe090902-040c-405c-9bbb-faa8b7133050 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:11.269452 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-fe090902-040c-405c-9bbb-faa8b7133050 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:11.277745 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-fe090902-040c-405c-9bbb-faa8b7133050 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463" status: 200 len: 1313 microversion: 2.1 time: 0.427197 Dec 14 10:19:11.278341 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 547/1142] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:10 2021] GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463 => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:11.815139 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-711aa71c-05d1-4e5b-b101-64d19738d5c8 req-aebc7d71-2ac3-45c9-a7de-4712fbcb2b54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3555bb79-153c-4a3f-8518-00ae09fe5463", "tag": "55027021-b63a-4bb7-b6f0-13e7ecb0c0ab"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:19:11.816671 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:19:11.816671 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:19:11.824886 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-711aa71c-05d1-4e5b-b101-64d19738d5c8 req-aebc7d71-2ac3-45c9-a7de-4712fbcb2b54 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:11.825322 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-711aa71c-05d1-4e5b-b101-64d19738d5c8 req-aebc7d71-2ac3-45c9-a7de-4712fbcb2b54 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:11.843398 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-711aa71c-05d1-4e5b-b101-64d19738d5c8 req-aebc7d71-2ac3-45c9-a7de-4712fbcb2b54 service nova] Creating event network-changed:55027021-b63a-4bb7-b6f0-13e7ecb0c0ab for instance 3555bb79-153c-4a3f-8518-00ae09fe5463 on hv-cinder-81888 Dec 14 10:19:11.848741 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-711aa71c-05d1-4e5b-b101-64d19738d5c8 req-aebc7d71-2ac3-45c9-a7de-4712fbcb2b54 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158411 Dec 14 10:19:11.849480 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 596/1143] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:19:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:19:12.295049 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-880aa665-c294-4f42-86b3-95fe653b3877 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:12.295655 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-880aa665-c294-4f42-86b3-95fe653b3877 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: 3555bb79-153c-4a3f-8518-00ae09fe5463] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:12.303013 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-880aa665-c294-4f42-86b3-95fe653b3877 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:12.303455 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-880aa665-c294-4f42-86b3-95fe653b3877 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:12.304223 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-880aa665-c294-4f42-86b3-95fe653b3877 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:12.304654 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-880aa665-c294-4f42-86b3-95fe653b3877 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:12.679450 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-880aa665-c294-4f42-86b3-95fe653b3877 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:12.687889 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-880aa665-c294-4f42-86b3-95fe653b3877 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463" status: 200 len: 1313 microversion: 2.1 time: 0.396435 Dec 14 10:19:12.688985 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 548/1144] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:12 2021] GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463 => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:13.705165 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-909091b2-45e1-423b-bd21-9f4a8435669f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:13.705935 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-909091b2-45e1-423b-bd21-9f4a8435669f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: 3555bb79-153c-4a3f-8518-00ae09fe5463] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:13.713284 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-909091b2-45e1-423b-bd21-9f4a8435669f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:13.713725 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-909091b2-45e1-423b-bd21-9f4a8435669f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:13.714507 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-909091b2-45e1-423b-bd21-9f4a8435669f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:13.714928 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-909091b2-45e1-423b-bd21-9f4a8435669f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:13.929399 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-909091b2-45e1-423b-bd21-9f4a8435669f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:13.937509 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-909091b2-45e1-423b-bd21-9f4a8435669f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463" status: 200 len: 1313 microversion: 2.1 time: 0.236570 Dec 14 10:19:13.938381 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 597/1145] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:13 2021] GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:19:14.954425 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-8e8636c8-59cb-4968-8902-a636f2535230 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:14.955037 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-8e8636c8-59cb-4968-8902-a636f2535230 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: 3555bb79-153c-4a3f-8518-00ae09fe5463] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:14.962135 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8e8636c8-59cb-4968-8902-a636f2535230 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:14.962583 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8e8636c8-59cb-4968-8902-a636f2535230 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:14.963345 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8e8636c8-59cb-4968-8902-a636f2535230 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:14.963774 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-8e8636c8-59cb-4968-8902-a636f2535230 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:15.158597 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-8e8636c8-59cb-4968-8902-a636f2535230 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:15.166499 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-8e8636c8-59cb-4968-8902-a636f2535230 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463" status: 200 len: 1313 microversion: 2.1 time: 0.215758 Dec 14 10:19:15.167039 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 549/1146] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:14 2021] GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:16.131795 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-71ba03fd-37a3-48db-a2f4-397482640c32 req-4f4ef778-37f7-4634-a539-95ef958902b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3555bb79-153c-4a3f-8518-00ae09fe5463", "name": "network-vif-plugged", "status": "completed", "tag": "55027021-b63a-4bb7-b6f0-13e7ecb0c0ab"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:19:16.133281 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:19:16.133281 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:19:16.142003 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-71ba03fd-37a3-48db-a2f4-397482640c32 req-4f4ef778-37f7-4634-a539-95ef958902b7 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:16.142506 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-71ba03fd-37a3-48db-a2f4-397482640c32 req-4f4ef778-37f7-4634-a539-95ef958902b7 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:16.160686 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-71ba03fd-37a3-48db-a2f4-397482640c32 req-4f4ef778-37f7-4634-a539-95ef958902b7 service nova] Creating event network-vif-plugged:55027021-b63a-4bb7-b6f0-13e7ecb0c0ab for instance 3555bb79-153c-4a3f-8518-00ae09fe5463 on hv-cinder-81888 Dec 14 10:19:16.165571 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-71ba03fd-37a3-48db-a2f4-397482640c32 req-4f4ef778-37f7-4634-a539-95ef958902b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089173 Dec 14 10:19:16.166188 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 598/1147] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:19:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:19:16.184434 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-32a04cbe-9751-4145-b74f-f4b47beed33f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:16.185062 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-32a04cbe-9751-4145-b74f-f4b47beed33f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: 3555bb79-153c-4a3f-8518-00ae09fe5463] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:16.193249 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-32a04cbe-9751-4145-b74f-f4b47beed33f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:16.193891 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-32a04cbe-9751-4145-b74f-f4b47beed33f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:16.194706 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-32a04cbe-9751-4145-b74f-f4b47beed33f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:16.195140 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-32a04cbe-9751-4145-b74f-f4b47beed33f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:16.488944 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-32a04cbe-9751-4145-b74f-f4b47beed33f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:16.497147 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-32a04cbe-9751-4145-b74f-f4b47beed33f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463" status: 200 len: 1313 microversion: 2.1 time: 0.317247 Dec 14 10:19:16.497722 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 550/1148] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:16 2021] GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:17.514950 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-61ab3230-7e08-4a60-8c62-243e25986e36 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:17.515638 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-61ab3230-7e08-4a60-8c62-243e25986e36 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: 3555bb79-153c-4a3f-8518-00ae09fe5463] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:17.523091 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-61ab3230-7e08-4a60-8c62-243e25986e36 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:17.523527 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-61ab3230-7e08-4a60-8c62-243e25986e36 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:17.524279 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-61ab3230-7e08-4a60-8c62-243e25986e36 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:17.524698 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-61ab3230-7e08-4a60-8c62-243e25986e36 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:17.728861 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-61ab3230-7e08-4a60-8c62-243e25986e36 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:17.737827 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-61ab3230-7e08-4a60-8c62-243e25986e36 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463" status: 200 len: 1313 microversion: 2.1 time: 0.226637 Dec 14 10:19:17.738738 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 599/1149] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:17 2021] GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:18.755041 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-a480e514-1181-4cc2-bf1b-835d0afd1692 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:18.755657 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-a480e514-1181-4cc2-bf1b-835d0afd1692 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: 3555bb79-153c-4a3f-8518-00ae09fe5463] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:18.762824 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a480e514-1181-4cc2-bf1b-835d0afd1692 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:18.763272 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a480e514-1181-4cc2-bf1b-835d0afd1692 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:18.764042 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a480e514-1181-4cc2-bf1b-835d0afd1692 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:18.764473 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-a480e514-1181-4cc2-bf1b-835d0afd1692 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:19.078612 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-a480e514-1181-4cc2-bf1b-835d0afd1692 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:19.086988 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-a480e514-1181-4cc2-bf1b-835d0afd1692 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463" status: 200 len: 1497 microversion: 2.1 time: 0.335671 Dec 14 10:19:19.087543 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 551/1150] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:18 2021] GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463 => generated 1497 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:19.712529 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-7a883177-f81a-4812-966f-b8cce36ddba6 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:19.713087 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-7a883177-f81a-4812-966f-b8cce36ddba6 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: 3555bb79-153c-4a3f-8518-00ae09fe5463] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:19.720575 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7a883177-f81a-4812-966f-b8cce36ddba6 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:19.721033 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7a883177-f81a-4812-966f-b8cce36ddba6 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:19.721806 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7a883177-f81a-4812-966f-b8cce36ddba6 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:19.722269 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-7a883177-f81a-4812-966f-b8cce36ddba6 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:19.785379 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-7a883177-f81a-4812-966f-b8cce36ddba6 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: 3555bb79-153c-4a3f-8518-00ae09fe5463] Going to try to terminate instance {{(pid=100984) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:19:19.893826 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-7a883177-f81a-4812-966f-b8cce36ddba6 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463" status: 204 len: 0 microversion: 2.1 time: 0.184614 Dec 14 10:19:19.894480 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 600/1151] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:19:19 2021] DELETE /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 10:19:19.902490 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-6d4c7029-a610-48e8-9bcd-f2b5f9eac19d tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:19.903369 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-6d4c7029-a610-48e8-9bcd-f2b5f9eac19d tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: 3555bb79-153c-4a3f-8518-00ae09fe5463] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:19.910636 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6d4c7029-a610-48e8-9bcd-f2b5f9eac19d tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:19.911087 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6d4c7029-a610-48e8-9bcd-f2b5f9eac19d tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:19.911856 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6d4c7029-a610-48e8-9bcd-f2b5f9eac19d tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:19.912293 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-6d4c7029-a610-48e8-9bcd-f2b5f9eac19d tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:20.115342 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-6d4c7029-a610-48e8-9bcd-f2b5f9eac19d tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:20.123474 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-6d4c7029-a610-48e8-9bcd-f2b5f9eac19d tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463" status: 200 len: 1503 microversion: 2.1 time: 0.224694 Dec 14 10:19:20.124030 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 552/1152] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:19 2021] GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463 => generated 1503 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:19:21.142113 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e007913b-aea6-4e82-94a3-ba39afc91f28 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:21.142806 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e007913b-aea6-4e82-94a3-ba39afc91f28 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: 3555bb79-153c-4a3f-8518-00ae09fe5463] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:21.149920 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e007913b-aea6-4e82-94a3-ba39afc91f28 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:21.150395 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e007913b-aea6-4e82-94a3-ba39afc91f28 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:21.151154 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e007913b-aea6-4e82-94a3-ba39afc91f28 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:21.151580 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e007913b-aea6-4e82-94a3-ba39afc91f28 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:21.344991 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e007913b-aea6-4e82-94a3-ba39afc91f28 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:21.354461 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e007913b-aea6-4e82-94a3-ba39afc91f28 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463" status: 200 len: 1503 microversion: 2.1 time: 0.216577 Dec 14 10:19:21.355131 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 601/1153] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:21 2021] GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463 => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:22.123298 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-5dc54a20-8452-4823-b492-19460c9f3293 req-80800aa6-30b7-4ba6-81ee-993c4a0759ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3555bb79-153c-4a3f-8518-00ae09fe5463", "name": "network-vif-deleted", "tag": "55027021-b63a-4bb7-b6f0-13e7ecb0c0ab"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:19:22.124850 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:19:22.124850 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:19:22.133852 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-5dc54a20-8452-4823-b492-19460c9f3293 req-80800aa6-30b7-4ba6-81ee-993c4a0759ef service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:22.134338 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-5dc54a20-8452-4823-b492-19460c9f3293 req-80800aa6-30b7-4ba6-81ee-993c4a0759ef service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:22.150734 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-5dc54a20-8452-4823-b492-19460c9f3293 req-80800aa6-30b7-4ba6-81ee-993c4a0759ef service nova] Creating event network-vif-deleted:55027021-b63a-4bb7-b6f0-13e7ecb0c0ab for instance 3555bb79-153c-4a3f-8518-00ae09fe5463 on hv-cinder-81888 Dec 14 10:19:22.155688 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-5dc54a20-8452-4823-b492-19460c9f3293 req-80800aa6-30b7-4ba6-81ee-993c4a0759ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036141 Dec 14 10:19:22.156295 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 553/1154] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:19:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:19:22.371999 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-ca8a5ae0-a8b4-4e1e-b8b9-c62f397220f1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:22.372573 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-ca8a5ae0-a8b4-4e1e-b8b9-c62f397220f1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: 3555bb79-153c-4a3f-8518-00ae09fe5463] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:22.380392 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ca8a5ae0-a8b4-4e1e-b8b9-c62f397220f1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:22.380836 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ca8a5ae0-a8b4-4e1e-b8b9-c62f397220f1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:22.381686 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ca8a5ae0-a8b4-4e1e-b8b9-c62f397220f1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:22.382150 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ca8a5ae0-a8b4-4e1e-b8b9-c62f397220f1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:22.451566 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ca8a5ae0-a8b4-4e1e-b8b9-c62f397220f1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:22.452004 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-ca8a5ae0-a8b4-4e1e-b8b9-c62f397220f1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:22.452445 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.objects.instance [None req-ca8a5ae0-a8b4-4e1e-b8b9-c62f397220f1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lazy-loading 'fault' on Instance uuid 3555bb79-153c-4a3f-8518-00ae09fe5463 {{(pid=100984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:19:22.512295 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-ca8a5ae0-a8b4-4e1e-b8b9-c62f397220f1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:22.520405 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-ca8a5ae0-a8b4-4e1e-b8b9-c62f397220f1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463" status: 200 len: 1303 microversion: 2.1 time: 0.152136 Dec 14 10:19:22.520962 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 602/1155] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:22 2021] GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463 => generated 1303 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:23.537943 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-ee939ada-2a8d-4405-989c-c255a2601bfa tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:23.538667 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-ee939ada-2a8d-4405-989c-c255a2601bfa tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: 3555bb79-153c-4a3f-8518-00ae09fe5463] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:23.546075 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ee939ada-2a8d-4405-989c-c255a2601bfa tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:23.546520 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ee939ada-2a8d-4405-989c-c255a2601bfa tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:23.547403 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ee939ada-2a8d-4405-989c-c255a2601bfa tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:23.548011 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-ee939ada-2a8d-4405-989c-c255a2601bfa tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:23.598760 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-ee939ada-2a8d-4405-989c-c255a2601bfa tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] HTTP exception thrown: Instance 3555bb79-153c-4a3f-8518-00ae09fe5463 could not be found. Dec 14 10:19:23.599342 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-ee939ada-2a8d-4405-989c-c255a2601bfa tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Returning 404 to user: Instance 3555bb79-153c-4a3f-8518-00ae09fe5463 could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:19:23.600153 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-ee939ada-2a8d-4405-989c-c255a2601bfa tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463" status: 404 len: 111 microversion: 2.1 time: 0.066398 Dec 14 10:19:23.600674 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 554/1156] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:23 2021] GET /compute/v2.1/servers/3555bb79-153c-4a3f-8518-00ae09fe5463 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:19:23.650935 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-bd242828-83f8-48c0-b512-219ecc5d9308 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-204886094", "imageRef": "5be36fdc-2baa-4efd-b830-5a5c3fd7beba", "flavorRef": "452", "networks": [{"uuid": "23855567-e612-4fa6-957a-5f2beab24937"}]}} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:19:23.714078 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.network.neutron [None req-bd242828-83f8-48c0-b512-219ecc5d9308 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] validate_networks() for [('23855567-e612-4fa6-957a-5f2beab24937', None, None, None)] {{(pid=100984) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 14 10:19:24.283989 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-bd242828-83f8-48c0-b512-219ecc5d9308 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Flavor limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 14 10:19:24.284418 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-bd242828-83f8-48c0-b512-219ecc5d9308 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Image limits 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 14 10:19:24.285000 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-bd242828-83f8-48c0-b512-219ecc5d9308 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Flavor pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 14 10:19:24.285409 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-bd242828-83f8-48c0-b512-219ecc5d9308 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Image pref 0:0:0 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 14 10:19:24.285813 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.virt.hardware [None req-bd242828-83f8-48c0-b512-219ecc5d9308 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 14 10:19:24.293998 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bd242828-83f8-48c0-b512-219ecc5d9308 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:24.294444 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bd242828-83f8-48c0-b512-219ecc5d9308 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:24.295256 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bd242828-83f8-48c0-b512-219ecc5d9308 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:24.295680 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-bd242828-83f8-48c0-b512-219ecc5d9308 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:24.313364 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-bd242828-83f8-48c0-b512-219ecc5d9308 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Getting quotas for project 51c3d9486e5240b49749f90b95d2e3d1. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 14 10:19:24.317274 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.quota [None req-bd242828-83f8-48c0-b512-219ecc5d9308 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Getting quotas for user 81b2242fde814a65966d5f6372d33a2d and project 51c3d9486e5240b49749f90b95d2e3d1. Resources: {'cores', 'instances', 'ram'} {{(pid=100984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 14 10:19:24.327527 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-bd242828-83f8-48c0-b512-219ecc5d9308 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Going to run 1 instances... {{(pid=100984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 14 10:19:24.330440 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-bd242828-83f8-48c0-b512-219ecc5d9308 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: d094ceba-8bf8-4af5-86ec-9a1486ab0772] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5be36fdc-2baa-4efd-b830-5a5c3fd7beba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 14 10:19:24.373396 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-bd242828-83f8-48c0-b512-219ecc5d9308 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726126 Dec 14 10:19:24.374046 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 603/1157] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Dec 14 10:19:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 14 10:19:24.384610 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-d09f2e25-d9eb-4e49-852b-221e9cfb8f2b tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:24.385218 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-d09f2e25-d9eb-4e49-852b-221e9cfb8f2b tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: d094ceba-8bf8-4af5-86ec-9a1486ab0772] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:24.474939 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-d09f2e25-d9eb-4e49-852b-221e9cfb8f2b tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:24.482513 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-d09f2e25-d9eb-4e49-852b-221e9cfb8f2b tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772" status: 200 len: 1213 microversion: 2.1 time: 0.101778 Dec 14 10:19:24.483356 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 555/1158] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:24 2021] GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772 => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:25.500678 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-0d6c8287-e469-416c-be77-59b0d57178fb tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:25.501933 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-0d6c8287-e469-416c-be77-59b0d57178fb tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: d094ceba-8bf8-4af5-86ec-9a1486ab0772] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:25.509306 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0d6c8287-e469-416c-be77-59b0d57178fb tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:25.509745 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0d6c8287-e469-416c-be77-59b0d57178fb tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:25.510748 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0d6c8287-e469-416c-be77-59b0d57178fb tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:25.511174 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-0d6c8287-e469-416c-be77-59b0d57178fb tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:25.628304 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-0d6c8287-e469-416c-be77-59b0d57178fb tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:25.636999 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-0d6c8287-e469-416c-be77-59b0d57178fb tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772" status: 200 len: 1271 microversion: 2.1 time: 0.140551 Dec 14 10:19:25.647830 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 604/1159] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:25 2021] GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772 => generated 1271 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:26.656077 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-91effac0-d47d-481a-a64d-4185437fbaa0 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:26.657282 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-91effac0-d47d-481a-a64d-4185437fbaa0 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: d094ceba-8bf8-4af5-86ec-9a1486ab0772] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:26.665014 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-91effac0-d47d-481a-a64d-4185437fbaa0 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:26.665457 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-91effac0-d47d-481a-a64d-4185437fbaa0 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:26.666313 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-91effac0-d47d-481a-a64d-4185437fbaa0 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:26.666746 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-91effac0-d47d-481a-a64d-4185437fbaa0 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:27.160737 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-91effac0-d47d-481a-a64d-4185437fbaa0 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:27.168713 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-91effac0-d47d-481a-a64d-4185437fbaa0 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772" status: 200 len: 1313 microversion: 2.1 time: 0.517076 Dec 14 10:19:27.169264 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 556/1160] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:26 2021] GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772 => generated 1313 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:27.374088 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-33bad72b-ddb6-4793-b2f0-57dc6f2bca18 req-0c0be9c0-e09b-4f97-a4ae-f9faf4f79abe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d094ceba-8bf8-4af5-86ec-9a1486ab0772", "tag": "0b10b904-8b1c-426c-8c5a-21a00129c531"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:19:27.376507 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:19:27.376507 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:19:27.387179 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-33bad72b-ddb6-4793-b2f0-57dc6f2bca18 req-0c0be9c0-e09b-4f97-a4ae-f9faf4f79abe service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:27.387620 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-33bad72b-ddb6-4793-b2f0-57dc6f2bca18 req-0c0be9c0-e09b-4f97-a4ae-f9faf4f79abe service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:27.407110 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-33bad72b-ddb6-4793-b2f0-57dc6f2bca18 req-0c0be9c0-e09b-4f97-a4ae-f9faf4f79abe service nova] Creating event network-changed:0b10b904-8b1c-426c-8c5a-21a00129c531 for instance d094ceba-8bf8-4af5-86ec-9a1486ab0772 on hv-cinder-81888 Dec 14 10:19:27.412308 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-33bad72b-ddb6-4793-b2f0-57dc6f2bca18 req-0c0be9c0-e09b-4f97-a4ae-f9faf4f79abe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041854 Dec 14 10:19:27.413186 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 605/1161] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:19:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:19:28.185292 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-680503fc-675f-4311-9dfb-904529f73f8b tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:28.186019 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-680503fc-675f-4311-9dfb-904529f73f8b tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: d094ceba-8bf8-4af5-86ec-9a1486ab0772] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:28.193892 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-680503fc-675f-4311-9dfb-904529f73f8b tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:28.194366 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-680503fc-675f-4311-9dfb-904529f73f8b tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:28.195125 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-680503fc-675f-4311-9dfb-904529f73f8b tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:28.195552 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-680503fc-675f-4311-9dfb-904529f73f8b tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:28.610301 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-680503fc-675f-4311-9dfb-904529f73f8b tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:28.618212 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-680503fc-675f-4311-9dfb-904529f73f8b tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772" status: 200 len: 1313 microversion: 2.1 time: 0.436572 Dec 14 10:19:28.618769 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 557/1162] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:28 2021] GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772 => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:29.635206 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-fbb5a52a-704c-49bf-b9f6-d004b487ced0 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:29.635900 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-fbb5a52a-704c-49bf-b9f6-d004b487ced0 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: d094ceba-8bf8-4af5-86ec-9a1486ab0772] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:29.643819 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fbb5a52a-704c-49bf-b9f6-d004b487ced0 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:29.644267 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fbb5a52a-704c-49bf-b9f6-d004b487ced0 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:29.645025 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fbb5a52a-704c-49bf-b9f6-d004b487ced0 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:29.645458 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-fbb5a52a-704c-49bf-b9f6-d004b487ced0 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:29.841820 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-fbb5a52a-704c-49bf-b9f6-d004b487ced0 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:29.849996 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-fbb5a52a-704c-49bf-b9f6-d004b487ced0 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772" status: 200 len: 1313 microversion: 2.1 time: 0.218969 Dec 14 10:19:29.850559 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 606/1163] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:29 2021] GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:30.867902 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-d9d9cbb5-336a-4e51-ac84-1871a51f185f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:30.868818 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-d9d9cbb5-336a-4e51-ac84-1871a51f185f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: d094ceba-8bf8-4af5-86ec-9a1486ab0772] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:30.877976 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d9d9cbb5-336a-4e51-ac84-1871a51f185f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:30.878804 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d9d9cbb5-336a-4e51-ac84-1871a51f185f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:30.880152 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d9d9cbb5-336a-4e51-ac84-1871a51f185f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:30.880961 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-d9d9cbb5-336a-4e51-ac84-1871a51f185f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:31.116196 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-d9d9cbb5-336a-4e51-ac84-1871a51f185f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:31.128001 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-d9d9cbb5-336a-4e51-ac84-1871a51f185f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772" status: 200 len: 1313 microversion: 2.1 time: 0.263794 Dec 14 10:19:31.128662 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 558/1164] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:30 2021] GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:32.146687 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-e19b2f2c-101c-4ce6-9bfd-18caad0d5152 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:32.147510 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-e19b2f2c-101c-4ce6-9bfd-18caad0d5152 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: d094ceba-8bf8-4af5-86ec-9a1486ab0772] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:32.154769 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e19b2f2c-101c-4ce6-9bfd-18caad0d5152 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:32.155208 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e19b2f2c-101c-4ce6-9bfd-18caad0d5152 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:32.156544 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e19b2f2c-101c-4ce6-9bfd-18caad0d5152 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:32.157124 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-e19b2f2c-101c-4ce6-9bfd-18caad0d5152 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:32.165501 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [req-5aeba045-a5a4-4fb8-a7bf-ad3b8ef18e82 req-ecead55e-a056-4932-a6f3-906ac8333d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d094ceba-8bf8-4af5-86ec-9a1486ab0772", "name": "network-vif-plugged", "status": "completed", "tag": "0b10b904-8b1c-426c-8c5a-21a00129c531"}]} {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:19:32.167081 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:19:32.167081 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: warnings.warn(msg) Dec 14 10:19:32.177078 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-5aeba045-a5a4-4fb8-a7bf-ad3b8ef18e82 req-ecead55e-a056-4932-a6f3-906ac8333d0b service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:32.177527 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [req-5aeba045-a5a4-4fb8-a7bf-ad3b8ef18e82 req-ecead55e-a056-4932-a6f3-906ac8333d0b service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:32.193159 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.compute.server_external_events [req-5aeba045-a5a4-4fb8-a7bf-ad3b8ef18e82 req-ecead55e-a056-4932-a6f3-906ac8333d0b service nova] Creating event network-vif-plugged:0b10b904-8b1c-426c-8c5a-21a00129c531 for instance d094ceba-8bf8-4af5-86ec-9a1486ab0772 on hv-cinder-81888 Dec 14 10:19:32.197880 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [req-5aeba045-a5a4-4fb8-a7bf-ad3b8ef18e82 req-ecead55e-a056-4932-a6f3-906ac8333d0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036040 Dec 14 10:19:32.198848 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 559/1165] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:19:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:19:32.362912 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-e19b2f2c-101c-4ce6-9bfd-18caad0d5152 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:32.371040 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-e19b2f2c-101c-4ce6-9bfd-18caad0d5152 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772" status: 200 len: 1313 microversion: 2.1 time: 0.228011 Dec 14 10:19:32.371606 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 607/1166] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:32 2021] GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:33.389626 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-89f3f541-632e-4d41-88f1-47ba3216c400 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:33.390506 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-89f3f541-632e-4d41-88f1-47ba3216c400 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: d094ceba-8bf8-4af5-86ec-9a1486ab0772] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:33.398356 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-89f3f541-632e-4d41-88f1-47ba3216c400 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:33.398809 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-89f3f541-632e-4d41-88f1-47ba3216c400 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:33.399619 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-89f3f541-632e-4d41-88f1-47ba3216c400 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:33.400061 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-89f3f541-632e-4d41-88f1-47ba3216c400 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:33.604717 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-89f3f541-632e-4d41-88f1-47ba3216c400 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:33.613343 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-89f3f541-632e-4d41-88f1-47ba3216c400 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772" status: 200 len: 1313 microversion: 2.1 time: 0.227906 Dec 14 10:19:33.613900 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 560/1167] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:33 2021] GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:34.630575 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-974b55ba-f798-48a8-8819-09f38a02f561 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:34.631178 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-974b55ba-f798-48a8-8819-09f38a02f561 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: d094ceba-8bf8-4af5-86ec-9a1486ab0772] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:34.638423 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-974b55ba-f798-48a8-8819-09f38a02f561 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:34.638863 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-974b55ba-f798-48a8-8819-09f38a02f561 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:34.639618 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-974b55ba-f798-48a8-8819-09f38a02f561 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:34.640045 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-974b55ba-f798-48a8-8819-09f38a02f561 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:34.835626 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-974b55ba-f798-48a8-8819-09f38a02f561 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:34.843648 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-974b55ba-f798-48a8-8819-09f38a02f561 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772" status: 200 len: 1497 microversion: 2.1 time: 0.217031 Dec 14 10:19:34.844204 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 608/1168] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:34 2021] GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772 => generated 1497 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:35.508447 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-2a39cd02-948a-422f-9bfe-9220ce458b8f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:35.508970 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-2a39cd02-948a-422f-9bfe-9220ce458b8f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: d094ceba-8bf8-4af5-86ec-9a1486ab0772] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:35.516171 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2a39cd02-948a-422f-9bfe-9220ce458b8f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:35.516613 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2a39cd02-948a-422f-9bfe-9220ce458b8f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:35.517375 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2a39cd02-948a-422f-9bfe-9220ce458b8f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:35.517812 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-2a39cd02-948a-422f-9bfe-9220ce458b8f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:35.576886 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-2a39cd02-948a-422f-9bfe-9220ce458b8f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: d094ceba-8bf8-4af5-86ec-9a1486ab0772] Going to try to terminate instance {{(pid=100985) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:19:35.688571 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-2a39cd02-948a-422f-9bfe-9220ce458b8f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772" status: 204 len: 0 microversion: 2.1 time: 0.183252 Dec 14 10:19:35.689345 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 561/1169] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:19:35 2021] DELETE /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 10:19:35.697551 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-4dace9a6-5313-4f18-a0c9-55f64bb461d1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:35.698215 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-4dace9a6-5313-4f18-a0c9-55f64bb461d1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: d094ceba-8bf8-4af5-86ec-9a1486ab0772] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:35.705878 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4dace9a6-5313-4f18-a0c9-55f64bb461d1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:35.706354 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4dace9a6-5313-4f18-a0c9-55f64bb461d1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:35.707137 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4dace9a6-5313-4f18-a0c9-55f64bb461d1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:35.707563 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-4dace9a6-5313-4f18-a0c9-55f64bb461d1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:35.905532 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-4dace9a6-5313-4f18-a0c9-55f64bb461d1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:35.914338 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-4dace9a6-5313-4f18-a0c9-55f64bb461d1 tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772" status: 200 len: 1503 microversion: 2.1 time: 0.220441 Dec 14 10:19:35.914906 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 609/1170] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:35 2021] GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772 => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:36.932005 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-3d676085-f7a2-4447-be76-f9a4ce5b24ca tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:36.932698 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-3d676085-f7a2-4447-be76-f9a4ce5b24ca tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: d094ceba-8bf8-4af5-86ec-9a1486ab0772] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:36.940482 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3d676085-f7a2-4447-be76-f9a4ce5b24ca tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:36.940873 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3d676085-f7a2-4447-be76-f9a4ce5b24ca tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:36.941676 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3d676085-f7a2-4447-be76-f9a4ce5b24ca tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:36.942156 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-3d676085-f7a2-4447-be76-f9a4ce5b24ca tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:37.347697 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-3d676085-f7a2-4447-be76-f9a4ce5b24ca tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:37.356441 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-3d676085-f7a2-4447-be76-f9a4ce5b24ca tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772" status: 200 len: 1503 microversion: 2.1 time: 0.428453 Dec 14 10:19:37.357150 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 562/1171] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:36 2021] GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772 => generated 1503 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:38.000236 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-4033112d-540b-49df-b17f-77f6cda0e8d0 req-d25c90e1-496e-4d5c-ac10-f5781d44f702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d094ceba-8bf8-4af5-86ec-9a1486ab0772", "name": "network-vif-deleted", "tag": "0b10b904-8b1c-426c-8c5a-21a00129c531"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:19:38.002095 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:19:38.002095 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:19:38.010805 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-4033112d-540b-49df-b17f-77f6cda0e8d0 req-d25c90e1-496e-4d5c-ac10-f5781d44f702 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:38.011244 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-4033112d-540b-49df-b17f-77f6cda0e8d0 req-d25c90e1-496e-4d5c-ac10-f5781d44f702 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:38.030657 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-4033112d-540b-49df-b17f-77f6cda0e8d0 req-d25c90e1-496e-4d5c-ac10-f5781d44f702 service nova] Creating event network-vif-deleted:0b10b904-8b1c-426c-8c5a-21a00129c531 for instance d094ceba-8bf8-4af5-86ec-9a1486ab0772 on hv-cinder-81888 Dec 14 10:19:38.035611 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-4033112d-540b-49df-b17f-77f6cda0e8d0 req-d25c90e1-496e-4d5c-ac10-f5781d44f702 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039630 Dec 14 10:19:38.036381 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 610/1172] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:19:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:19:38.373513 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-e660564d-c435-449f-8866-113bd45e091f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:38.374156 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-e660564d-c435-449f-8866-113bd45e091f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: d094ceba-8bf8-4af5-86ec-9a1486ab0772] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:38.381745 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e660564d-c435-449f-8866-113bd45e091f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:38.382148 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e660564d-c435-449f-8866-113bd45e091f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:38.382920 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e660564d-c435-449f-8866-113bd45e091f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:38.383353 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e660564d-c435-449f-8866-113bd45e091f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:38.450912 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e660564d-c435-449f-8866-113bd45e091f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:38.451357 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-e660564d-c435-449f-8866-113bd45e091f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:38.451845 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.objects.instance [None req-e660564d-c435-449f-8866-113bd45e091f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lazy-loading 'fault' on Instance uuid d094ceba-8bf8-4af5-86ec-9a1486ab0772 {{(pid=100985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 14 10:19:38.525519 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-e660564d-c435-449f-8866-113bd45e091f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b2242fde814a65966d5f6372d33a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3d9486e5240b49749f90b95d2e3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:19:38.535202 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-e660564d-c435-449f-8866-113bd45e091f tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772" status: 200 len: 1303 microversion: 2.1 time: 0.165340 Dec 14 10:19:38.535855 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 563/1173] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:38 2021] GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772 => generated 1303 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:19:39.553693 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-606fbd28-c257-43bf-b178-4e311bcaab7c tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:19:39.554401 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-606fbd28-c257-43bf-b178-4e311bcaab7c tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] [instance: d094ceba-8bf8-4af5-86ec-9a1486ab0772] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:19:39.561722 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-606fbd28-c257-43bf-b178-4e311bcaab7c tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:39.562806 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-606fbd28-c257-43bf-b178-4e311bcaab7c tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:39.563554 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-606fbd28-c257-43bf-b178-4e311bcaab7c tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:19:39.563974 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-606fbd28-c257-43bf-b178-4e311bcaab7c tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:19:39.611789 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-606fbd28-c257-43bf-b178-4e311bcaab7c tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] HTTP exception thrown: Instance d094ceba-8bf8-4af5-86ec-9a1486ab0772 could not be found. Dec 14 10:19:39.612368 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-606fbd28-c257-43bf-b178-4e311bcaab7c tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] Returning 404 to user: Instance d094ceba-8bf8-4af5-86ec-9a1486ab0772 could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:19:39.613167 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-606fbd28-c257-43bf-b178-4e311bcaab7c tempest-VolumesActionsTest-1517161001 tempest-VolumesActionsTest-1517161001-project] 10.222.0.20 "GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772" status: 404 len: 111 microversion: 2.1 time: 0.063569 Dec 14 10:19:39.613691 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 611/1174] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:19:39 2021] GET /compute/v2.1/servers/d094ceba-8bf8-4af5-86ec-9a1486ab0772 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:20:43.187040 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-84caa5df-71f5-418f-88da-1f8f67211b50 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:20:43.187664 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-84caa5df-71f5-418f-88da-1f8f67211b50 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:20:43.189017 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-66b024b4-b73a-4be6-b8d0-83097be3d614 req-410e448b-6f8a-40b8-b4fe-f5b987b1a9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a460f6af-ea8f-4919-a434-d18f79e91fd6", "tag": "a75e5b84-f235-4d33-9d34-15a4fbd8cb85"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:20:43.190675 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:20:43.190675 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:20:43.195053 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-84caa5df-71f5-418f-88da-1f8f67211b50 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:43.195506 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-84caa5df-71f5-418f-88da-1f8f67211b50 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:43.196284 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-84caa5df-71f5-418f-88da-1f8f67211b50 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:43.196720 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-84caa5df-71f5-418f-88da-1f8f67211b50 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:43.199606 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-66b024b4-b73a-4be6-b8d0-83097be3d614 req-410e448b-6f8a-40b8-b4fe-f5b987b1a9a5 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:43.200106 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-66b024b4-b73a-4be6-b8d0-83097be3d614 req-410e448b-6f8a-40b8-b4fe-f5b987b1a9a5 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:43.215910 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-66b024b4-b73a-4be6-b8d0-83097be3d614 req-410e448b-6f8a-40b8-b4fe-f5b987b1a9a5 service nova] Creating event network-changed:a75e5b84-f235-4d33-9d34-15a4fbd8cb85 for instance a460f6af-ea8f-4919-a434-d18f79e91fd6 on hv-cinder-81888 Dec 14 10:20:43.221606 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-66b024b4-b73a-4be6-b8d0-83097be3d614 req-410e448b-6f8a-40b8-b4fe-f5b987b1a9a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036269 Dec 14 10:20:43.222720 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 612/1175] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:20:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:20:43.264338 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-84caa5df-71f5-418f-88da-1f8f67211b50 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Going to try to terminate instance {{(pid=100985) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:20:43.386915 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-84caa5df-71f5-418f-88da-1f8f67211b50 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 204 len: 0 microversion: 2.1 time: 0.203579 Dec 14 10:20:43.388877 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 564/1176] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:20:43 2021] DELETE /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 10:20:43.397742 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-f32600c2-fd8d-43e7-8b4a-aac74e04a619 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:20:43.398490 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-f32600c2-fd8d-43e7-8b4a-aac74e04a619 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:20:43.407245 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f32600c2-fd8d-43e7-8b4a-aac74e04a619 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:43.408134 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f32600c2-fd8d-43e7-8b4a-aac74e04a619 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:43.408528 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f32600c2-fd8d-43e7-8b4a-aac74e04a619 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:43.408960 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-f32600c2-fd8d-43e7-8b4a-aac74e04a619 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:43.740794 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-f32600c2-fd8d-43e7-8b4a-aac74e04a619 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:20:43.749337 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-f32600c2-fd8d-43e7-8b4a-aac74e04a619 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 200 len: 1575 microversion: 2.1 time: 0.355758 Dec 14 10:20:43.750110 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 613/1177] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:20:43 2021] GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 1575 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:20:44.768017 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-871012c9-66c6-4aae-aeec-ad162ca2f89d tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:20:44.768711 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-871012c9-66c6-4aae-aeec-ad162ca2f89d tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:20:44.776124 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-871012c9-66c6-4aae-aeec-ad162ca2f89d tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:44.776561 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-871012c9-66c6-4aae-aeec-ad162ca2f89d tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:44.777319 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-871012c9-66c6-4aae-aeec-ad162ca2f89d tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:44.777750 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-871012c9-66c6-4aae-aeec-ad162ca2f89d tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:45.081782 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-871012c9-66c6-4aae-aeec-ad162ca2f89d tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:20:45.089977 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-871012c9-66c6-4aae-aeec-ad162ca2f89d tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 200 len: 1457 microversion: 2.1 time: 0.326037 Dec 14 10:20:45.090552 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 565/1178] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:20:44 2021] GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 1457 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:20:45.854440 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-0a24442d-12a4-4378-b349-635c8c8ba75f req-414086de-e390-46d8-bdaa-6cb17adb02f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a460f6af-ea8f-4919-a434-d18f79e91fd6", "name": "network-vif-deleted", "tag": "a75e5b84-f235-4d33-9d34-15a4fbd8cb85"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:20:45.868803 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:20:45.868803 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:20:45.877778 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-0a24442d-12a4-4378-b349-635c8c8ba75f req-414086de-e390-46d8-bdaa-6cb17adb02f3 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:45.878243 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-0a24442d-12a4-4378-b349-635c8c8ba75f req-414086de-e390-46d8-bdaa-6cb17adb02f3 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:45.893780 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-0a24442d-12a4-4378-b349-635c8c8ba75f req-414086de-e390-46d8-bdaa-6cb17adb02f3 service nova] Creating event network-vif-deleted:a75e5b84-f235-4d33-9d34-15a4fbd8cb85 for instance a460f6af-ea8f-4919-a434-d18f79e91fd6 on hv-cinder-81888 Dec 14 10:20:45.898322 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-0a24442d-12a4-4378-b349-635c8c8ba75f req-414086de-e390-46d8-bdaa-6cb17adb02f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047487 Dec 14 10:20:45.898895 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 614/1179] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:20:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 14 10:20:46.107882 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-5a464a9c-a965-4ea9-a598-fede9a151cef tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:20:46.109382 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-5a464a9c-a965-4ea9-a598-fede9a151cef tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:20:46.116697 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5a464a9c-a965-4ea9-a598-fede9a151cef tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:46.117140 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5a464a9c-a965-4ea9-a598-fede9a151cef tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:46.117928 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5a464a9c-a965-4ea9-a598-fede9a151cef tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:46.118396 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5a464a9c-a965-4ea9-a598-fede9a151cef tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:46.272435 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-5a464a9c-a965-4ea9-a598-fede9a151cef tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:20:46.283496 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-5a464a9c-a965-4ea9-a598-fede9a151cef tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 200 len: 1224 microversion: 2.1 time: 0.179254 Dec 14 10:20:46.284062 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 566/1180] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:20:46 2021] GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 1224 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:20:47.301258 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-b32ac45a-58c8-4178-bed6-bb779cceb764 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:20:47.301944 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-b32ac45a-58c8-4178-bed6-bb779cceb764 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: a460f6af-ea8f-4919-a434-d18f79e91fd6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:20:47.309286 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b32ac45a-58c8-4178-bed6-bb779cceb764 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:47.309665 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b32ac45a-58c8-4178-bed6-bb779cceb764 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:47.310483 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b32ac45a-58c8-4178-bed6-bb779cceb764 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:47.310911 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-b32ac45a-58c8-4178-bed6-bb779cceb764 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:47.361783 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-b32ac45a-58c8-4178-bed6-bb779cceb764 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] HTTP exception thrown: Instance a460f6af-ea8f-4919-a434-d18f79e91fd6 could not be found. Dec 14 10:20:47.362422 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-b32ac45a-58c8-4178-bed6-bb779cceb764 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Returning 404 to user: Instance a460f6af-ea8f-4919-a434-d18f79e91fd6 could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:20:47.363215 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-b32ac45a-58c8-4178-bed6-bb779cceb764 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6" status: 404 len: 111 microversion: 2.1 time: 0.066918 Dec 14 10:20:47.363951 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 615/1181] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:20:47 2021] GET /compute/v2.1/servers/a460f6af-ea8f-4919-a434-d18f79e91fd6 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:20:51.245438 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-9f66fd0c-4d4a-4f25-b57c-42edfcaae70d tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:20:51.251342 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-3d16c535-9b2c-40c7-9845-625af5d26206 req-9b258fd1-00fe-464d-a022-055ac3749063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c457d9c4-d3ef-4ae8-a78c-eb75762205aa", "tag": "4c4fd8bf-4fbe-4f99-a91b-0b9bd1365298"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:20:51.252836 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:20:51.252836 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:20:51.255946 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-9f66fd0c-4d4a-4f25-b57c-42edfcaae70d tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:20:51.264983 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9f66fd0c-4d4a-4f25-b57c-42edfcaae70d tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:51.265563 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9f66fd0c-4d4a-4f25-b57c-42edfcaae70d tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:51.266275 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-3d16c535-9b2c-40c7-9845-625af5d26206 req-9b258fd1-00fe-464d-a022-055ac3749063 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:51.266425 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9f66fd0c-4d4a-4f25-b57c-42edfcaae70d tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:51.266799 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-9f66fd0c-4d4a-4f25-b57c-42edfcaae70d tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:51.266964 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-3d16c535-9b2c-40c7-9845-625af5d26206 req-9b258fd1-00fe-464d-a022-055ac3749063 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:51.284437 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-3d16c535-9b2c-40c7-9845-625af5d26206 req-9b258fd1-00fe-464d-a022-055ac3749063 service nova] Creating event network-changed:4c4fd8bf-4fbe-4f99-a91b-0b9bd1365298 for instance c457d9c4-d3ef-4ae8-a78c-eb75762205aa on hv-cinder-81888 Dec 14 10:20:51.289737 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-3d16c535-9b2c-40c7-9845-625af5d26206 req-9b258fd1-00fe-464d-a022-055ac3749063 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042384 Dec 14 10:20:51.290472 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 616/1182] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:20:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:20:51.336582 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-9f66fd0c-4d4a-4f25-b57c-42edfcaae70d tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Going to try to terminate instance {{(pid=100985) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 14 10:20:51.454924 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-9f66fd0c-4d4a-4f25-b57c-42edfcaae70d tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 204 len: 0 microversion: 2.1 time: 0.212911 Dec 14 10:20:51.458082 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 567/1183] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:20:51 2021] DELETE /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 14 10:20:51.464855 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-2511609c-524a-4f21-9565-44f2b59e8d8b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:20:51.465764 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-2511609c-524a-4f21-9565-44f2b59e8d8b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:20:51.474107 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2511609c-524a-4f21-9565-44f2b59e8d8b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:51.474775 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2511609c-524a-4f21-9565-44f2b59e8d8b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:51.475722 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2511609c-524a-4f21-9565-44f2b59e8d8b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:51.476144 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-2511609c-524a-4f21-9565-44f2b59e8d8b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:51.680885 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.policy [None req-2511609c-524a-4f21-9565-44f2b59e8d8b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100984) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:20:51.689787 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-2511609c-524a-4f21-9565-44f2b59e8d8b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1577 microversion: 2.1 time: 0.228937 Dec 14 10:20:51.690686 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 617/1184] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:20:51 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:20:52.708349 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-81a25451-5549-4490-bc61-46a120490988 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:20:52.709048 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-81a25451-5549-4490-bc61-46a120490988 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:20:52.716349 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-81a25451-5549-4490-bc61-46a120490988 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:52.716790 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-81a25451-5549-4490-bc61-46a120490988 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:52.717556 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-81a25451-5549-4490-bc61-46a120490988 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:52.718666 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-81a25451-5549-4490-bc61-46a120490988 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:52.979774 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-81a25451-5549-4490-bc61-46a120490988 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:20:52.987993 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-81a25451-5549-4490-bc61-46a120490988 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1458 microversion: 2.1 time: 0.283918 Dec 14 10:20:52.988566 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 568/1185] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:20:52 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1458 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 14 10:20:53.816143 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [req-6b485a7a-3d05-45e1-829d-edb2aa826701 req-8448e9ee-b206-49ef-8450-af388ea2f916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c457d9c4-d3ef-4ae8-a78c-eb75762205aa", "name": "network-vif-deleted", "tag": "4c4fd8bf-4fbe-4f99-a91b-0b9bd1365298"}]} {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 14 10:20:53.817691 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 14 10:20:53.817691 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: warnings.warn(msg) Dec 14 10:20:53.825718 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-6b485a7a-3d05-45e1-829d-edb2aa826701 req-8448e9ee-b206-49ef-8450-af388ea2f916 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:53.826182 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [req-6b485a7a-3d05-45e1-829d-edb2aa826701 req-8448e9ee-b206-49ef-8450-af388ea2f916 service nova] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:53.842045 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.compute.server_external_events [req-6b485a7a-3d05-45e1-829d-edb2aa826701 req-8448e9ee-b206-49ef-8450-af388ea2f916 service nova] Creating event network-vif-deleted:4c4fd8bf-4fbe-4f99-a91b-0b9bd1365298 for instance c457d9c4-d3ef-4ae8-a78c-eb75762205aa on hv-cinder-81888 Dec 14 10:20:53.847648 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [req-6b485a7a-3d05-45e1-829d-edb2aa826701 req-8448e9ee-b206-49ef-8450-af388ea2f916 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034997 Dec 14 10:20:53.848427 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 618/1186] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Dec 14 10:20:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 14 10:20:54.004540 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-daec9c72-aec2-4ab9-b08e-1a89c649b938 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:20:54.005086 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-daec9c72-aec2-4ab9-b08e-1a89c649b938 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:20:54.012318 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-daec9c72-aec2-4ab9-b08e-1a89c649b938 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:54.012768 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-daec9c72-aec2-4ab9-b08e-1a89c649b938 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:54.013543 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-daec9c72-aec2-4ab9-b08e-1a89c649b938 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:54.013996 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-daec9c72-aec2-4ab9-b08e-1a89c649b938 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:54.148824 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.policy [None req-daec9c72-aec2-4ab9-b08e-1a89c649b938 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9766e50607147dbad279b733d671264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1381b4c2d5654dc2bf924671ef0ec4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100985) authorize /opt/stack/nova/nova/policy.py:199}} Dec 14 10:20:54.158521 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-daec9c72-aec2-4ab9-b08e-1a89c649b938 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 200 len: 1225 microversion: 2.1 time: 0.157566 Dec 14 10:20:54.159104 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 569/1187] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:20:53 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 1225 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 14 10:20:55.176405 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-59da0a0d-867c-460a-ac26-d46a6420edb5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:20:55.177104 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-59da0a0d-867c-460a-ac26-d46a6420edb5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: c457d9c4-d3ef-4ae8-a78c-eb75762205aa] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:20:55.184519 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-59da0a0d-867c-460a-ac26-d46a6420edb5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:55.184956 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-59da0a0d-867c-460a-ac26-d46a6420edb5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:55.185704 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-59da0a0d-867c-460a-ac26-d46a6420edb5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:55.186162 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-59da0a0d-867c-460a-ac26-d46a6420edb5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:55.233104 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-59da0a0d-867c-460a-ac26-d46a6420edb5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] HTTP exception thrown: Instance c457d9c4-d3ef-4ae8-a78c-eb75762205aa could not be found. Dec 14 10:20:55.234354 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-59da0a0d-867c-460a-ac26-d46a6420edb5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Returning 404 to user: Instance c457d9c4-d3ef-4ae8-a78c-eb75762205aa could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:20:55.235149 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-59da0a0d-867c-460a-ac26-d46a6420edb5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa" status: 404 len: 111 microversion: 2.1 time: 0.062900 Dec 14 10:20:55.235664 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 619/1188] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:20:55 2021] GET /compute/v2.1/servers/c457d9c4-d3ef-4ae8-a78c-eb75762205aa => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:20:55.984989 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-5ef76006-6fc1-4b25-b741-e3ef10b325fd tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:20:55.985497 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.compute.api [None req-5ef76006-6fc1-4b25-b741-e3ef10b325fd tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100985) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:20:55.993128 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5ef76006-6fc1-4b25-b741-e3ef10b325fd tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:55.993580 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5ef76006-6fc1-4b25-b741-e3ef10b325fd tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:55.994381 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5ef76006-6fc1-4b25-b741-e3ef10b325fd tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:55.994814 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG oslo_concurrency.lockutils [None req-5ef76006-6fc1-4b25-b741-e3ef10b325fd tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:56.044413 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.wsgi [None req-5ef76006-6fc1-4b25-b741-e3ef10b325fd tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] HTTP exception thrown: Instance fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 could not be found. Dec 14 10:20:56.045003 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-5ef76006-6fc1-4b25-b741-e3ef10b325fd tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Returning 404 to user: Instance fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 could not be found. {{(pid=100985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:20:56.045852 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-5ef76006-6fc1-4b25-b741-e3ef10b325fd tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 404 len: 111 microversion: 2.1 time: 0.064751 Dec 14 10:20:56.046425 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 570/1189] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Dec 14 10:20:55 2021] DELETE /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:20:56.054475 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-16986ede-3f6e-48d0-88d6-604797d2650b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '>' {{(pid=100984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:20:56.055094 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.compute.api [None req-16986ede-3f6e-48d0-88d6-604797d2650b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [instance: fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6] Fetching instance by UUID {{(pid=100984) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 14 10:20:56.062998 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-16986ede-3f6e-48d0-88d6-604797d2650b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:56.063446 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-16986ede-3f6e-48d0-88d6-604797d2650b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:56.064219 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-16986ede-3f6e-48d0-88d6-604797d2650b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 14 10:20:56.064652 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG oslo_concurrency.lockutils [None req-16986ede-3f6e-48d0-88d6-604797d2650b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Lock "26d0cb61-6736-4223-b055-fa824f7338a4" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 14 10:20:56.115342 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.wsgi [None req-16986ede-3f6e-48d0-88d6-604797d2650b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] HTTP exception thrown: Instance fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 could not be found. Dec 14 10:20:56.115924 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: DEBUG nova.api.openstack.wsgi [None req-16986ede-3f6e-48d0-88d6-604797d2650b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Returning 404 to user: Instance fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 could not be found. {{(pid=100984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 14 10:20:56.116733 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO nova.api.openstack.requestlog [None req-16986ede-3f6e-48d0-88d6-604797d2650b tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6" status: 404 len: 111 microversion: 2.1 time: 0.066053 Dec 14 10:20:56.117264 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: [pid: 100984|app: 0|req: 620/1190] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Dec 14 10:20:56 2021] GET /compute/v2.1/servers/fe0800a0-4c96-4067-8e8d-e8d37ccbcfc6 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 14 10:20:57.538371 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: DEBUG nova.api.openstack.wsgi [None req-c53c834c-e991-4906-a556-454dc7f8e2f5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] Calling method '.version_select at 0x7fb179882940>' {{(pid=100985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 14 10:20:57.541660 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c53c834c-e991-4906-a556-454dc7f8e2f5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [fc2564b5-648c-4c12-9c16-6ae73f07fb6d] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 14 10:20:58.558134 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO oslo.messaging._drivers.impl_rabbit [None req-c53c834c-e991-4906-a556-454dc7f8e2f5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] [fc2564b5-648c-4c12-9c16-6ae73f07fb6d] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51344. Dec 14 10:20:58.579563 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO nova.api.openstack.requestlog [None req-c53c834c-e991-4906-a556-454dc7f8e2f5 tempest-TestVolumeBootPattern-784275322 tempest-TestVolumeBootPattern-784275322-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-621328310" status: 202 len: 0 microversion: 2.1 time: 1.045959 Dec 14 10:20:58.580124 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: [pid: 100985|app: 0|req: 571/1191] 10.222.0.20 () {58 vars in 1259 bytes} [Tue Dec 14 10:20:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-621328310 => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 14 10:21:33.606938 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 10:21:33.607671 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: Tue Dec 14 10:21:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 10:21:46.733632 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 10:21:46.734202 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: Tue Dec 14 10:21:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 10:23:35.468837 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 10:23:35.469654 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: Tue Dec 14 10:23:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 10:23:44.986696 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 10:23:44.987227 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: Tue Dec 14 10:23:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 10:24:53.625990 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 10:24:53.626701 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: Tue Dec 14 10:24:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 10:24:53.806751 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 10:24:53.807216 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: Tue Dec 14 10:24:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 10:25:06.750425 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 10:25:06.751131 dv-cinder-818885-1-iscsi devstack@n-api.service[100984]: Tue Dec 14 10:25:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 14 10:26:21.619480 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 14 10:26:21.620081 dv-cinder-818885-1-iscsi devstack@n-api.service[100985]: Tue Dec 14 10:26:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!